Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 463.192761ms FAIL (2025-07-06 23:10:32 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 463.224216ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 516.112369ms FAIL (2025-07-06 23:10:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 516.145804ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 847.695953ms FAIL (2025-07-06 23:10:01 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 847.759759ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 457.07701ms FAIL (2025-07-06 23:09:31 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 457.173158ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 758.182654ms FAIL (2025-07-06 23:09:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 758.205473ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 804.150819ms FAIL (2025-07-06 23:08:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 804.17171ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 500.755407ms FAIL (2025-07-06 23:08:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 500.843511ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 507.051783ms FAIL (2025-07-06 23:08:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 507.074395ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 452.820319ms FAIL (2025-07-06 23:08:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 452.852487ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 961.402764ms FAIL (2025-07-06 23:07:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 961.423371ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 442.802436ms FAIL (2025-07-06 23:07:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 442.865996ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 3.375477263s FAIL (2025-07-06 23:06:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.3755001s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 482.263229ms FAIL (2025-07-06 23:06:27 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 482.292711ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 948.325721ms FAIL (2025-07-06 23:06:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 948.354457ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 462.893115ms FAIL (2025-07-06 23:05:58 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 462.920973ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 844.59091ms FAIL (2025-07-06 23:05:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 844.6099ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 440.455631ms FAIL (2025-07-06 23:04:59 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 440.481947ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.077008297s FAIL (2025-07-06 23:04:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.077026857s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 908.620487ms FAIL (2025-07-06 23:04:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 908.65274ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 542.046117ms FAIL (2025-07-06 23:04:03 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 542.082583ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 476.352802ms FAIL (2025-07-06 23:03:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 476.404593ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 822.688601ms FAIL (2025-07-06 23:02:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 822.718481ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 1.106706405s FAIL (2025-07-06 23:02:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.106726572s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 609.67441ms FAIL (2025-07-06 23:02:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 609.704701ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.414065458s FAIL (2025-07-06 23:01:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.414113596s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 404.467311ms FAIL (2025-07-06 23:01:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 404.495808ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 669.437181ms FAIL (2025-07-06 23:01:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 669.471496ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.053515972s FAIL (2025-07-06 23:00:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.053538558s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 799.625558ms FAIL (2025-07-06 23:00:06 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 799.66217ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.125805086s FAIL (2025-07-06 22:59:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.125824604s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 449.744396ms FAIL (2025-07-06 22:59:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 449.769458ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 520.283745ms FAIL (2025-07-06 22:59:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 520.308933ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 478.161481ms FAIL (2025-07-06 22:59:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 478.182067ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 846.349721ms FAIL (2025-07-06 22:59:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 846.369916ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 953.379009ms FAIL (2025-07-06 22:58:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 954.00559ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 462.092336ms FAIL (2025-07-06 22:58:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 462.120629ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 950.200585ms FAIL (2025-07-06 22:58:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 950.37469ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 462.419098ms FAIL (2025-07-06 22:58:00 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 462.4528ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 481.576213ms FAIL (2025-07-06 22:57:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 481.612606ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 904.57567ms FAIL (2025-07-06 22:57:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 904.605196ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 445.074045ms FAIL (2025-07-06 22:56:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 445.106725ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.318354483s FAIL (2025-07-06 22:56:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.318742581s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 444.50303ms FAIL (2025-07-06 22:55:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 444.529863ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 425.733956ms FAIL (2025-07-06 22:55:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 425.761258ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 916.026681ms FAIL (2025-07-06 22:54:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 916.268059ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 565.272641ms FAIL (2025-07-06 22:54:31 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 565.303562ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 517.979633ms FAIL (2025-07-06 22:54:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 518.009629ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.607459571s FAIL (2025-07-06 22:53:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.607485105s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 560.031968ms FAIL (2025-07-06 22:53:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 560.057274ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 554.010734ms FAIL (2025-07-06 22:53:13 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 25h25m55.361742804s) [upload=260769]: Got next segment. Inline: false Jul 6 22:37:28.435492991 (325h25m55.361787688s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 6 22:37:28.435500377 (325h25m55.361795073s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 6 22:37:28.475468435 (325h25m55.401763124s) [seg_pos={0 0}, upload=260769]: Begin upload segment... Jul 6 22:37:28.475525431 (325h25m55.401820125s) [seg_pos={0 0}, upload=260769]: Done begin upload segment. Jul 6 22:37:28.475557145 (325h25m55.401851842s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475571255 (325h25m55.40186595s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.475685830 (325h25m55.401980528s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476158395 (325h25m55.402453091s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476170039 (325h25m55.402464735s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476597058 (325h25m55.402891761s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476682225 (325h25m55.402976925s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.476961731 (325h25m55.403256427s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477131527 (325h25m55.403426215s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477303263 (325h25m55.403597966s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477550266 (325h25m55.403844955s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477659395 (325h25m55.403954094s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.477995661 (325h25m55.404290357s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478011022 (325h25m55.404305719s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478370683 (325h25m55.404665381s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478440835 (325h25m55.404735525s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.478862247 (325h25m55.40515694s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.479317662 (325h25m55.405612372s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Uploading piece... Jul 6 22:37:28.583530796 (325h25m55.509825491s) [upload=260769]: Next returned nil segment Jul 6 22:37:28.583554476 (325h25m55.509849183s) [upload=260769]: Waiting for error group managing segments... Jul 6 22:37:28.593188159 (325h25m55.51948285s) [noise=true , address=77.90.31.13:4656 , piece_id=JZDKOUXFVBIPWDNJJ2CEE35WTNBQNJNQKEOOK2JPEC2XXNSGNSSQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594237326 (325h25m55.520532011s) [noise=true , address=77.90.31.13:4640 , piece_id=Y3EIFIJ66A55KSQRC7S3DQMZQFJWIDX3AJAV42PRKEDB7NIKKMHQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.594498446 (325h25m55.520793119s) [noise=true , address=77.90.31.14:4674 , piece_id=6RZYVKTXPWI4SPC7SNIZHKLOWM54MSW2BFKYLF2SA3SEPDU6KESQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.595893536 (325h25m55.522188216s) [noise=true , address=77.90.31.15:4702 , piece_id=XX37CWXF2TWIQENXTUNVD32GZKJCQEEVULN62E6Y7Q7NWWZST2EQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.596234256 (325h25m55.52252893s) [noise=true , address=77.90.31.12:4612 , piece_id=R3TVFBEB7F5CCEEMCN4HU3TIMHDXOZNQIOA7IQDGQTAVELLX2P4A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597106515 (325h25m55.523401192s) [noise=true , address=104.36.82.60:4346 , piece_id=7TEOESUASIA2L5R2CFK5K4D3MWVS4VUXIEDP7YYSD5UARAVQE3UA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.597199390 (325h25m55.523494076s) [noise=true , address=104.36.82.34:4565 , piece_id=2NP5LIKNIK7JZCYNDG7HB4SFVV2A76Q2RIYWBZJNEXVL5QDUVSQA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.600500895 (325h25m55.526795583s) [noise=true , address=45.91.116.9:4273 , piece_id=YVPP2NYDGDMT2GMAZ47CVEX7RLGFAGTUNQGMDXBVQG4H6JS7KYKA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.603000635 (325h25m55.529295319s) [noise=true , address=104.36.82.3:4793 , piece_id=XD57IIBTCUYFTKWY2AJ3FUZK7XZ57FFHRBEDXJWGY6LOLRWXU57A, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.605156008 (325h25m55.531450688s) [noise=true , address=104.36.82.10:4096 , piece_id=KKRSEJXNXXWTHRPZRECRUKGJFZS6UKW2HF2JRRZFHE6CJVARUSAQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.609885234 (325h25m55.53617992s) [noise=true , address=104.36.82.12:4179 , piece_id=XQ4VZL2MNVUVWLI6IBCQIFXEUYQLQAVYXZV3LWURQZGIXXBRMRPA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.610607908 (325h25m55.536902595s) [noise=true , address=77.90.31.21:4894 , piece_id=2OJ7LF7F6Q33MLU3IC5YVX2WNSTJS6SP46WAGJTB6TNUFIPX62YA, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.612902086 (325h25m55.539196759s) [noise=true , address=45.91.116.6:4004 , piece_id=TX3XSBP5QPMBCNOA4SDYAMJDBUIWNPHJFTNK4KHMMM64Y2LL2PQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622244006 (325h25m55.548538693s) [noise=true , address=104.36.82.36:4638 , piece_id=ZWY7EYQCRPSKMNFV7DHETGHHDBO25W7KPQFGIO22U6X46VFOOTPQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: <nil> Jul 6 22:37:28.622275216 (325h25m55.548569903s) [seg_pos={0 0}, upload=260769]: Segment reached optimal threshold of 14 pieces. Jul 6 22:37:28.622517876 (325h25m55.548812564s) [noise=true , address=104.36.82.8:4976 , piece_id=RNXKITMHZWIEHQ2CROSPEX35A6KM4T5FK6AIXPQNOR477QYKEBTQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129av1sWniou1aWC1EReoKyaxztX2g6bQwzSFpGqwxx3ZQ3nz5e): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622703448 (325h25m55.548998135s) [noise=true , address=79.127.205.234:4598 , piece_id=XYEX6GB7FKAEK3ZLHCVLANXC6KDVGSRTXP6VFKA5R2JT6Z56SPCQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: read tcp 159.223.143.39:51948->79.127.205.234:4598: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622743290 (325h25m55.54903797s) [noise=true , address=64.49.13.169:4710 , piece_id=YJYX6BUYUN5WJT2ASVDGD3IIEPFG5MDCE2N5GD77R4N4LP3PFNQQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: read tcp 159.223.143.39:47164->64.49.13.169:4710: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 6 22:37:28.622759239 (325h25m55.549053917s) [noise=true , address=104.36.82.5:4868 , piece_id=CUF55MM7EEREBC47WUUH4RBUYOSFNQ56NOYJVMN3AASOF4JXP2UQ, seg_pos={0 0}, upload=260769]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18Srfics6dFkQeHZ2WF5YkFuLm2719Pw4Xgg9ntk12KnTBcn8v): protocol: expected piece hash; context canceled; EOF Jul 6 22:37:28.622771253 (325h25m55.54906594s) [seg_pos={0 0}, upload=260769]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 6 22:37:28.622851917 (325h25m55.549146608s) [upload=260769]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 6 22:37:28.622857048 (325h25m55.549151734s) [upload=260769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 6 22:37:28.674888622 (325h25m55.601183318s) [upload=260769]: Done uploading segments... Jul 6 22:37:28.674913445 (325h25m55.601208134s) [upload=260769]: Upload finished. err: <nil> Duration: 554.05089ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)