Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 437.788462ms FAIL (2025-06-24 07:26:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 437.816606ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 383.642113ms FAIL (2025-06-24 07:25:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 383.670807ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 626.067325ms FAIL (2025-06-24 07:24:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 626.10079ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 464.765797ms FAIL (2025-06-24 07:23:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 464.813136ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 443.133293ms FAIL (2025-06-24 07:22:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 443.269913ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 350.122439ms FAIL (2025-06-24 07:21:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 350.149272ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 484.658015ms FAIL (2025-06-24 07:20:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 484.700339ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 519.529798ms FAIL (2025-06-24 07:19:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 519.562414ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 407.868201ms FAIL (2025-06-24 07:19:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 407.902014ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 388.621853ms FAIL (2025-06-24 07:18:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 388.648934ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 548.969723ms FAIL (2025-06-24 07:17:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 549.002542ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 457.808246ms FAIL (2025-06-24 07:16:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 457.842463ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 393.2531ms FAIL (2025-06-24 07:16:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 393.284433ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 460.886711ms FAIL (2025-06-24 07:16:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 460.918633ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 466.910765ms FAIL (2025-06-24 07:15:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 466.940144ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 601.50013ms FAIL (2025-06-24 07:14:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 601.527902ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 413.424634ms FAIL (2025-06-24 07:13:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 413.456995ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 458.538958ms FAIL (2025-06-24 07:13:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 458.638909ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 487.069912ms FAIL (2025-06-24 07:12:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 487.11146ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 525.048016ms FAIL (2025-06-24 07:11:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 525.07748ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 452.374613ms FAIL (2025-06-24 07:10:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 452.405535ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 504.37717ms FAIL (2025-06-24 07:10:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 504.491624ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 528.959427ms FAIL (2025-06-24 07:09:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 528.989489ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 414.47355ms FAIL (2025-06-24 07:09:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 414.506338ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 461.233491ms FAIL (2025-06-24 07:08:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 461.281504ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 522.324058ms FAIL (2025-06-24 07:07:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 522.355583ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 393.499559ms FAIL (2025-06-24 07:07:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 393.528327ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 725.8441ms FAIL (2025-06-24 07:06:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 725.87833ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 731.895294ms FAIL (2025-06-24 07:05:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 731.92135ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 578.491646ms FAIL (2025-06-24 07:04:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 578.524137ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 507.232942ms FAIL (2025-06-24 07:03:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 507.273986ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 442.48657ms FAIL (2025-06-24 07:02:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 442.511241ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 32.379793ms target: https://us1.storj.io/login FAIL (2025-06-24 05:31:47 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 32.402188ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 407.797394ms target: https://us1.storj.io/login FAIL (2025-06-24 05:31:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 407.823176ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 33.577803ms target: https://us1.storj.io/login FAIL (2025-06-24 05:30:30 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 33.66578ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 458.313233ms target: https://us1.storj.io/login FAIL (2025-06-24 05:30:03 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 458.37967ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 34.951649ms target: https://us1.storj.io/login FAIL (2025-06-24 05:28:50 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 34.982165ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 87.110944ms target: https://us1.storj.io/login FAIL (2025-06-24 05:28:34 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 87.156293ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 178.812002ms target: https://us1.storj.io/login FAIL (2025-06-24 05:28:10 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 178.845942ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 31.152071ms target: https://us1.storj.io/login FAIL (2025-06-24 05:27:15 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 31.225639ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 128.134282ms target: https://us1.storj.io/login FAIL (2025-06-24 05:26:48 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 128.166972ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 54.209352ms target: https://us1.storj.io/login FAIL (2025-06-24 05:25:33 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 54.247822ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 30.406953ms target: https://us1.storj.io/login FAIL (2025-06-24 05:24:45 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 30.439377ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 29.490968ms target: https://us1.storj.io/login FAIL (2025-06-24 05:24:30 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 29.519506ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 28.623306ms target: https://us1.storj.io/login FAIL (2025-06-24 05:23:23 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 28.646436ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 33.663322ms target: https://us1.storj.io/login FAIL (2025-06-24 05:22:25 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 33.690145ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 430.181103ms target: https://us1.storj.io/login FAIL (2025-06-24 05:22:07 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 430.210231ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 33.309073ms target: https://us1.storj.io/login FAIL (2025-06-24 05:21:19 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 33.328512ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 42.973772ms target: https://us1.storj.io/login FAIL (2025-06-24 05:20:10 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 43.005888ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 32.06269ms target: https://us1.storj.io/login FAIL (2025-06-24 05:19:40 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: i/o timeout Duration: 32.087816ms core satellite us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)