Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.866761726s FAIL (2025-06-24 08:06:43 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.866869307s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.927006691s FAIL (2025-06-24 08:05:40 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.92705015s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.735056971s FAIL (2025-06-24 08:05:08 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.735086725s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.805546127s FAIL (2025-06-24 08:04:16 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.805590205s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.798997031s FAIL (2025-06-24 08:03:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.799017159s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.733752659s FAIL (2025-06-24 08:03:18 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.733784727s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.85774358s FAIL (2025-06-24 08:02:20 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 1.857775955s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001508613s FAIL (2025-06-24 08:02:00 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 30.001530507s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 488.19804ms FAIL (2025-06-24 07:45:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 488.228239ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 725.427354ms FAIL (2025-06-24 07:44:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 725.467278ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 414.028609ms FAIL (2025-06-24 07:44:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 414.058917ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 449.50388ms FAIL (2025-06-24 07:43:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 449.534182ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 442.884517ms FAIL (2025-06-24 07:42:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 442.909707ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 412.572797ms FAIL (2025-06-24 07:41:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 412.60585ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 411.649092ms FAIL (2025-06-24 07:40:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 411.679826ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 562.08528ms FAIL (2025-06-24 07:40:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 562.20355ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 411.847869ms FAIL (2025-06-24 07:39:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 411.873477ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 427.998504ms FAIL (2025-06-24 07:39:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 428.028391ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 435.94562ms FAIL (2025-06-24 07:38:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 435.981864ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 425.074884ms FAIL (2025-06-24 07:37:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 425.104726ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 453.890223ms FAIL (2025-06-24 07:37:12 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 453.927851ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 406.868325ms FAIL (2025-06-24 07:36:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 406.898795ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 526.423672ms FAIL (2025-06-24 07:35:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 526.467496ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 525.873956ms FAIL (2025-06-24 07:35:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 525.89895ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 409.217978ms FAIL (2025-06-24 07:34:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 409.24425ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 479.528232ms FAIL (2025-06-24 07:34:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 479.555561ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 441.23132ms FAIL (2025-06-24 07:33:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 441.261322ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 440.452702ms FAIL (2025-06-24 07:32:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 440.479349ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 413.191514ms FAIL (2025-06-24 07:32:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 413.21718ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 606.999563ms FAIL (2025-06-24 07:31:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 607.02907ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 521.277407ms FAIL (2025-06-24 07:30:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 521.305907ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 416.395724ms FAIL (2025-06-24 07:29:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 416.427387ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 388.445162ms FAIL (2025-06-24 07:28:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 388.485023ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 419.266667ms FAIL (2025-06-24 07:27:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 419.295172ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 509.881731ms FAIL (2025-06-24 07:27:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 509.910379ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 437.788462ms FAIL (2025-06-24 07:26:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 437.816606ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 383.642113ms FAIL (2025-06-24 07:25:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 383.670807ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 626.067325ms FAIL (2025-06-24 07:24:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 626.10079ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 464.765797ms FAIL (2025-06-24 07:23:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 464.813136ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 443.133293ms FAIL (2025-06-24 07:22:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 443.269913ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 350.122439ms FAIL (2025-06-24 07:21:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 350.149272ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 484.658015ms FAIL (2025-06-24 07:20:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 484.700339ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 519.529798ms FAIL (2025-06-24 07:19:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 519.562414ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 407.868201ms FAIL (2025-06-24 07:19:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 407.902014ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 388.621853ms FAIL (2025-06-24 07:18:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 388.648934ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 548.969723ms FAIL (2025-06-24 07:17:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 549.002542ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 457.808246ms FAIL (2025-06-24 07:16:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 457.842463ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 393.2531ms FAIL (2025-06-24 07:16:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 393.284433ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 460.886711ms FAIL (2025-06-24 07:16:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 460.918633ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 466.910765ms FAIL (2025-06-24 07:15:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 7534]: Done uploading piece. err: <nil> Jun 24 07:00:45.402534035 (21h49m12.328828732s) [noise=true , address=77.90.31.14:4661 , piece_id=3HDBTCXZXL732HJG2EDWKY6NUXOVW22QILGCIMMUYOABCRN6DAZA, seg_pos={0 0}, upload=17534]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue): protocol: read tcp 159.223.143.39:52794->77.90.31.14:4661: use of closed network connection; context canceled Jun 24 07:00:45.402551430 (21h49m12.328846116s) [seg_pos={0 0}, upload=17534]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 24 07:00:45.402629450 (21h49m12.328924137s) [upload=17534]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:00:45.402634003 (21h49m12.328928691s) [upload=17534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:00:45.543408779 (21h49m12.469703465s) [upload=17534]: Done uploading segments... Jun 24 07:00:45.543428060 (21h49m12.469722746s) [upload=17534]: Upload finished. err: <nil> Jun 24 07:01:09.026601507 (21h49m35.952896202s) [upload=17543]: Starting upload Jun 24 07:01:09.026697501 (21h49m35.952992192s) [upload=17543]: Done starting upload Jun 24 07:01:09.027007560 (21h49m35.953302239s) [upload=17543]: Uploading segments... Jun 24 07:01:09.027326986 (21h49m35.953621681s) [upload=17543]: Got next segment. Inline: false Jun 24 07:01:09.027409770 (21h49m35.953704464s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 24 07:01:09.027418123 (21h49m35.953712819s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 24 07:01:09.081108463 (21h49m36.007403158s) [seg_pos={0 0}, upload=17543]: Begin upload segment... Jun 24 07:01:09.081185821 (21h49m36.007480514s) [seg_pos={0 0}, upload=17543]: Done begin upload segment. Jun 24 07:01:09.081217293 (21h49m36.00751199s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.081941508 (21h49m36.008236203s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082439099 (21h49m36.008733796s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.082913025 (21h49m36.009207719s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083319522 (21h49m36.00961422s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.083793415 (21h49m36.01008811s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084175927 (21h49m36.010470619s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084597742 (21h49m36.010892437s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.084974419 (21h49m36.011269112s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085308352 (21h49m36.011603041s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.085685021 (21h49m36.011979707s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086132964 (21h49m36.012427655s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086513078 (21h49m36.012807769s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.086936264 (21h49m36.013230953s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087355303 (21h49m36.013649996s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.087747664 (21h49m36.014042359s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Uploading piece... Jun 24 07:01:09.257798402 (21h49m36.184093089s) [upload=17543]: Next returned nil segment Jun 24 07:01:09.257825133 (21h49m36.184119844s) [upload=17543]: Waiting for error group managing segments... Jun 24 07:01:09.282035051 (21h49m36.20832973s) [noise=true , address=45.91.116.10:4082 , piece_id=WA22STW6XHHWHMUJNOLN6EWWIITHF65GBAB7A2FUKNX6DXFC6HLA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.283788935 (21h49m36.210083625s) [noise=true , address=77.90.31.17:4772 , piece_id=BOIGDIE7ARC7GMAWC3TBYEIN2PXEAH535PAL454L5M5JLBLIEW4Q, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284256624 (21h49m36.210551297s) [noise=true , address=77.90.31.18:4807 , piece_id=2XLHABQLI3Y3YPE6YV3PHM6QTCPJ36BHZ54LTNYWCS5HZ3BGN5KA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.284735891 (21h49m36.211030581s) [noise=true , address=77.90.31.19:4841 , piece_id=PNVU4ALF2YX7EAMD2BMME4BUSOKJWSZ2Y6XIFTIM6BLEQNXZVYKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.288943312 (21h49m36.215238s) [noise=true , address=45.91.116.5:5299 , piece_id=2B24ASIVWFGQX5IUYLV57GQK7L6BAEHPSJHQXHGKSKHJI5OLHDKA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289503870 (21h49m36.215798543s) [noise=true , address=45.91.116.12:5227 , piece_id=ONHMNYA5YK5TBYO424V7RVHX2AV52KUE4GT6YCOH3CUGX3ET74LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.289888825 (21h49m36.216183511s) [noise=true , address=45.91.116.7:4009 , piece_id=43XYQYDHEDQPOARRQQWCB5QDFVOFNAFCSUDWD2UXE2FRIKLMJQKQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290252050 (21h49m36.216546728s) [noise=true , address=45.91.116.10:4081 , piece_id=XPQODMUIK3HV7KXS2SGFATLQ4M2L23QNR7G7QQP3KH4H5BV7NEAA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.290454080 (21h49m36.216748768s) [noise=true , address=104.36.82.12:4150 , piece_id=2MWKTHA3OM7SZG5TRTKBRBBQUS3FXHT7W25OTNVTR4JCBEFLQ6EQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.292519616 (21h49m36.218814289s) [noise=true , address=45.91.116.5:5297 , piece_id=IIAPMORZYMCRCSWMDRK7NLMLG5WKU4JX354RMW6FUPLH7RD3PSVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.293969204 (21h49m36.220263891s) [noise=true , address=104.36.82.7:4912 , piece_id=KOU2KCNHKSQMIT6WXTPWV2SQ7G6YSPO7TYNNNMM3JGTOU66XP7LQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.298014075 (21h49m36.224308754s) [noise=true , address=104.36.82.13:4186 , piece_id=UNC3AACFF6BJUHEWXTQENHDGKRM25HVYQTKKYT7KTUDXNUA5A5YQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301229239 (21h49m36.227523912s) [noise=true , address=104.36.82.15:6257 , piece_id=RRWAH72YAVI6R4GO27KHNT5RO7Y5FS2NK6JMYKSNHNIYKFFZPPVA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: <nil> Jun 24 07:01:09.301253964 (21h49m36.227548641s) [seg_pos={0 0}, upload=17543]: Segment reached optimal threshold of 13 pieces. Jun 24 07:01:09.301522024 (21h49m36.227816718s) [noise=true , address=104.36.82.8:4971 , piece_id=MFHFSWGR32IZ7ATXOY63ZOTHPJTHGOVL6SYCQ3NHVAUSHCIVZGUQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ut4J9xtQTDXFFmCSv9rk6sBSjNpEdnyxo6cZWMXcpAvuQtebo): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301674653 (21h49m36.227969331s) [noise=true , address=104.36.82.3:4765 , piece_id=6AXIFKNNAMTKDNURZJID52EOFJUSSTVJK563WTFQJD4B2DZTX2CA, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301762332 (21h49m36.228057017s) [noise=true , address=104.36.82.6:5874 , piece_id=VE5AGWJASM6TT7BKYAC5DN4OH4RAI2HU6WHSY3WNZMEEJP436AJQ, seg_pos={0 0}, upload=17543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71): protocol: expected piece hash; context canceled; EOF Jun 24 07:01:09.301778997 (21h49m36.228073674s) [seg_pos={0 0}, upload=17543]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jun 24 07:01:09.301880892 (21h49m36.228175565s) [upload=17543]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 24 07:01:09.301886396 (21h49m36.228181087s) [upload=17543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 24 07:01:09.477888434 (21h49m36.40418312s) [upload=17543]: Done uploading segments... Jun 24 07:01:09.477904492 (21h49m36.404199168s) [upload=17543]: Upload finished. err: <nil> Duration: 466.940144ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)