Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
611.061959ms
FAIL (2025-08-07 10:07:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 611.103112ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
542.759168ms
FAIL (2025-08-07 10:06:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 542.78703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
416.0894ms
FAIL (2025-08-07 10:06:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 416.124898ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
462.323759ms
FAIL (2025-08-07 10:05:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 462.46742ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
562.577365ms
FAIL (2025-08-07 10:04:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 562.612637ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
435.998862ms
FAIL (2025-08-07 10:03:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 436.132548ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
498.272435ms
FAIL (2025-08-07 10:03:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 498.301459ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
459.669345ms
FAIL (2025-08-07 10:03:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 459.697454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
533.258585ms
FAIL (2025-08-07 10:02:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 533.284609ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.276431498s
FAIL (2025-08-07 10:01:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.276464219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
858.531694ms
FAIL (2025-08-07 10:01:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.608179ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
489.071519ms
FAIL (2025-08-07 09:59:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 489.099052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
465.947998ms
FAIL (2025-08-07 09:59:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 465.977825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
399.871939ms
FAIL (2025-08-07 09:58:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 399.903483ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
466.347137ms
FAIL (2025-08-07 09:58:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 466.380305ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
434.151509ms
FAIL (2025-08-07 09:57:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 434.182354ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
72.638688ms
FAIL (2025-08-07 09:56:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
upload segment...
Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment.
Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece...
Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment
Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments...
Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil>
Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces.
Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF
Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments...
Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil>
Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload
Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload
Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments...
Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false
Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests
Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments...
Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests
Duration: 72.662782ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
189.167402ms
FAIL (2025-08-07 09:39:23 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 189.189837ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
430.248413ms
FAIL (2025-08-07 09:38:37 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 430.349091ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
806.985984ms
FAIL (2025-08-07 09:38:21 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 807.012479ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
217.884102ms
FAIL (2025-08-07 09:38:18 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 217.912573ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
254.226541ms
FAIL (2025-08-07 09:37:46 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 254.242569ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
528.253829ms
FAIL (2025-08-07 09:37:44 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 528.281641ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
455.387141ms
FAIL (2025-08-07 09:37:11 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 455.484398ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
273.115209ms
FAIL (2025-08-07 09:37:05 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 273.144502ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
416.028364ms
FAIL (2025-08-07 09:36:34 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 416.055037ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
344.370377ms
FAIL (2025-08-07 09:36:09 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 344.41757ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
511.61036ms
FAIL (2025-08-07 09:35:37 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 511.652884ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
192.945061ms
FAIL (2025-08-07 09:34:59 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 192.977692ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
624.263846ms
FAIL (2025-08-07 09:34:56 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 624.29047ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
208.667688ms
FAIL (2025-08-07 09:34:39 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 208.692325ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
213.470501ms
FAIL (2025-08-07 09:33:50 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 213.49991ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
419.800888ms
FAIL (2025-08-07 09:33:48 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 419.832757ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
599.944856ms
FAIL (2025-08-07 09:32:52 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 599.974413ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
219.795586ms
FAIL (2025-08-07 09:32:40 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 219.822814ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
585.402027ms
FAIL (2025-08-07 09:31:58 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 585.435881ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
245.201519ms
FAIL (2025-08-07 09:31:26 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 245.234147ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
490.859686ms
FAIL (2025-08-07 09:31:24 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 490.893558ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
673.102329ms
FAIL (2025-08-07 09:31:00 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 673.133883ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
233.106269ms
FAIL (2025-08-07 09:30:18 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 233.142357ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
530.576716ms
FAIL (2025-08-07 09:30:16 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 530.609328ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
631.750976ms
FAIL (2025-08-07 09:29:56 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 631.783997ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
208.20296ms
FAIL (2025-08-07 09:29:52 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 208.231353ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
225.510658ms
FAIL (2025-08-07 09:29:04 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 225.564168ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
39.738627ms
FAIL (2025-08-07 09:28:45 UTC)
orbiter warning: operation: sync2.Copy uplink: too many requests
Duration: 39.757897ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
247.870582ms
FAIL (2025-08-07 09:28:42 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 247.907737ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
53.090396ms
FAIL (2025-08-07 09:27:52 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 53.11358ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
204.268207ms
FAIL (2025-08-07 09:05:46 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 204.300623ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
368.772914ms
FAIL (2025-08-07 09:04:58 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 368.797303ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
189.508972ms
FAIL (2025-08-07 09:03:49 UTC)
orbiter warning: operation: Commit uplink: too many requests
Duration: 189.54934ms
core
uplink
us-select-1
us1-placement-20
|