Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
548.208379ms
FAIL (2025-06-22 13:35:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 548.242009ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
493.380673ms
FAIL (2025-06-22 13:34:17 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 493.412084ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
566.277218ms
FAIL (2025-06-22 13:33:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 566.328116ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
415.065829ms
FAIL (2025-06-22 13:33:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 415.091409ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
433.642384ms
FAIL (2025-06-22 13:32:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 433.67346ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
418.028276ms
FAIL (2025-06-22 13:31:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 418.056034ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
469.650358ms
FAIL (2025-06-22 13:31:03 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 469.684384ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
544.857132ms
FAIL (2025-06-22 13:30:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 544.891317ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
440.136602ms
FAIL (2025-06-22 13:29:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 440.163504ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
580.997877ms
FAIL (2025-06-22 13:28:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 581.03177ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
457.443352ms
FAIL (2025-06-22 13:27:27 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 457.470647ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
592.719157ms
FAIL (2025-06-22 13:26:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 592.749226ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
499.241969ms
FAIL (2025-06-22 13:26:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 499.313824ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
472.090817ms
FAIL (2025-06-22 13:26:15 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 472.14186ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
482.061352ms
FAIL (2025-06-22 13:25:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 482.08582ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
410.445964ms
FAIL (2025-06-22 13:24:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 410.474137ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
438.881513ms
FAIL (2025-06-22 13:24:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 438.905019ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
570.38959ms
FAIL (2025-06-22 13:24:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 570.478893ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
460.265424ms
FAIL (2025-06-22 13:23:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 460.370442ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
563.101931ms
FAIL (2025-06-22 13:22:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 563.132236ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
472.294237ms
FAIL (2025-06-22 13:21:45 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 472.317729ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
420.743494ms
FAIL (2025-06-22 13:20:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 420.767646ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
516.243767ms
FAIL (2025-06-22 13:20:29 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 516.27366ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
474.44791ms
FAIL (2025-06-22 13:19:33 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 474.499052ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
546.019772ms
FAIL (2025-06-22 13:18:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 546.050707ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
433.861447ms
FAIL (2025-06-22 13:18:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 433.913008ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
652.665362ms
FAIL (2025-06-22 13:17:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 652.69ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
908.990836ms
FAIL (2025-06-22 13:16:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 909.02067ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
428.647549ms
FAIL (2025-06-22 13:16:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 428.675945ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
415.431721ms
FAIL (2025-06-22 13:15:41 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 415.456966ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
573.737911ms
FAIL (2025-06-22 13:15:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 573.771231ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
484.611051ms
FAIL (2025-06-22 13:14:15 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 484.640716ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
466.323272ms
FAIL (2025-06-22 13:13:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 466.351467ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
496.970995ms
FAIL (2025-06-22 13:12:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 497.000334ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
472.056142ms
FAIL (2025-06-22 13:11:03 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 472.084568ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
477.456353ms
FAIL (2025-06-22 13:10:16 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 477.51102ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
502.30392ms
FAIL (2025-06-22 13:09:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 502.335306ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
446.423201ms
FAIL (2025-06-22 13:09:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 446.45393ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
504.810841ms
FAIL (2025-06-22 13:08:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 504.859787ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
511.85178ms
FAIL (2025-06-22 13:07:36 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 511.902494ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
420.75534ms
FAIL (2025-06-22 13:06:40 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 420.785657ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
506.86447ms
FAIL (2025-06-22 13:05:52 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 506.894041ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
447.384711ms
FAIL (2025-06-22 13:04:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 447.40749ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
423.139238ms
FAIL (2025-06-22 13:03:57 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 423.171359ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
473.860367ms
FAIL (2025-06-22 13:03:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil>
Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload
Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload
Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments...
Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false
Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment...
Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment.
Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece...
Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment
Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments...
Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil>
Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces.
Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF
Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments...
Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil>
Duration: 473.893296ms
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
72.815302ms
FAIL (2025-06-22 06:40:34 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 72.923013ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
68.603313ms
FAIL (2025-06-22 06:39:46 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 68.631561ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
69.057734ms
FAIL (2025-06-22 06:38:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 69.099003ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
65.457272ms
FAIL (2025-06-22 06:37:59 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 65.48409ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
78.127805ms
FAIL (2025-06-22 06:37:31 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 78.152354ms
edge
authservice
http
us-select-1
|