Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [X...XX......................................................] duration: 1.078404135s FAIL (2025-07-29 13:42:54 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 1.07849282s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [XXXXX..XXXX...................X.............................] duration: 701.862038ms FAIL (2025-07-29 13:42:41 UTC) orbiter warning: uplink: too many requests Duration: 701.882362ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [.XXXXX..XXXX...................X............................] duration: 767.180483ms FAIL (2025-07-29 13:41:59 UTC) orbiter warning: uplink: too many requests Duration: 767.213232ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [XX...XX.....................................................] duration: 762.723762ms FAIL (2025-07-29 13:41:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 762.756352ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.XX...XX....................................................] duration: 634.663689ms FAIL (2025-07-29 13:41:19 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 634.695773ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [..XXXXX..XXXX...................X...........................] duration: 566.153269ms FAIL (2025-07-29 13:41:09 UTC) orbiter warning: uplink: too many requests Duration: 566.186344ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [...XXXXX..XXXX...................X..........................] duration: 599.851844ms FAIL (2025-07-29 13:40:32 UTC) orbiter warning: uplink: too many requests Duration: 599.925747ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [X.XX...XX...................................................] duration: 659.101692ms FAIL (2025-07-29 13:40:07 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 659.220618ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [....XXXXX..XXXX...................X.........................] duration: 606.183576ms FAIL (2025-07-29 13:39:44 UTC) orbiter warning: uplink: too many requests Duration: 606.212818ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.X.XX...XX..................................................] duration: 760.607876ms FAIL (2025-07-29 13:39:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 760.640471ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..X.XX...XX.................................................] duration: 1.045097492s FAIL (2025-07-29 13:38:51 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 1.045131697s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [.....XXXXX..XXXX...................X........................] duration: 662.592647ms FAIL (2025-07-29 13:38:44 UTC) orbiter warning: uplink: too many requests Duration: 662.628482ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [...X.XX...XX................................................] duration: 554.056396ms FAIL (2025-07-29 13:38:00 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 554.086238ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [....X.XX...XX...............................................] duration: 541.251439ms FAIL (2025-07-29 13:37:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 541.296662ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 10 out of 60 is failed (threshold=3) [......XXXXX..XXXX...................X.......................] duration: 751.814553ms FAIL (2025-07-29 13:37:44 UTC) orbiter warning: uplink: too many requests Duration: 751.840141ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.....X.XX...XX..............................................] duration: 821.715413ms FAIL (2025-07-29 13:37:20 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 821.742471ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 11 out of 60 is failed (threshold=3) [X......XXXXX..XXXX...................X......................] duration: 674.574876ms FAIL (2025-07-29 13:37:02 UTC) orbiter warning: uplink: too many requests Duration: 674.601799ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 12 out of 60 is failed (threshold=3) [XX......XXXXX..XXXX...................X.....................] duration: 557.303322ms FAIL (2025-07-29 13:36:46 UTC) orbiter warning: uplink: too many requests Duration: 557.331579ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [......X.XX...XX.............................................] duration: 875.161964ms FAIL (2025-07-29 13:36:22 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 875.196696ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.......X.XX...XX............................................] duration: 640.845587ms FAIL (2025-07-29 13:36:02 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 640.877469ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 13 out of 60 is failed (threshold=3) [XXX......XXXXX..XXXX...................X....................] duration: 808.033954ms FAIL (2025-07-29 13:35:54 UTC) orbiter warning: uplink: too many requests Duration: 808.058353ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [........X.XX...XX...........................................] duration: 1.314715665s FAIL (2025-07-29 13:35:28 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 1.314742775s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [XXXX......XXXXX..XXXX...................X...................] duration: 580.596542ms FAIL (2025-07-29 13:35:03 UTC) orbiter warning: uplink: too many requests Duration: 580.631243ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [.XXXX......XXXXX..XXXX...................X..................] duration: 1.011072165s FAIL (2025-07-29 13:34:46 UTC) orbiter warning: uplink: too many requests Duration: 1.011103049s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.........X.XX...XX..........................................] duration: 893.473382ms FAIL (2025-07-29 13:34:42 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 893.501659ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 678.811951ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:34:34 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 678.837747ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..........X.XX...XX.........................................] duration: 543.141586ms FAIL (2025-07-29 13:34:24 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 543.172736ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [..XXXX......XXXXX..XXXX...................X.................] duration: 1.408785219s FAIL (2025-07-29 13:33:47 UTC) orbiter warning: uplink: too many requests Duration: 1.4088847s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 238.096948ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:33:39 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 238.130705ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 245.784814ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:33:22 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 245.812033ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [...........X.XX...XX........................................] duration: 741.601853ms FAIL (2025-07-29 13:33:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 741.628151ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [...XXXX......XXXXX..XXXX...................X................] duration: 752.174995ms FAIL (2025-07-29 13:33:17 UTC) orbiter warning: uplink: too many requests Duration: 752.291083ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 243.235744ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:32:48 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 243.264145ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 683.870455ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:32:26 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 683.899941ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [............X.XX...XX.......................................] duration: 829.126ms FAIL (2025-07-29 13:32:15 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 829.217094ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [....XXXX......XXXXX..XXXX...................X...............] duration: 704.227563ms FAIL (2025-07-29 13:32:05 UTC) orbiter warning: uplink: too many requests Duration: 704.254562ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.............X.XX...XX......................................] duration: 700.186602ms FAIL (2025-07-29 13:31:45 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 700.218416ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 248.108717ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:31:25 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 248.140794ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 101.815229ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-29 13:31:24 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 101.900569ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [.....XXXX......XXXXX..XXXX...................X..............] duration: 675.490521ms FAIL (2025-07-29 13:31:04 UTC) orbiter warning: uplink: too many requests Duration: 675.586093ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..............X.XX...XX.....................................] duration: 807.157472ms FAIL (2025-07-29 13:30:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 807.203207ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 101.248917ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-29 13:30:19 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 101.274576ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 677.985377ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:30:16 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 678.023702ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.477562324s FAIL (2025-07-29 13:30:12 UTC) orbiter warning: uplink: encryption: context deadline exceeded Duration: 4.477606803s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [...............X.XX...XX....................................] duration: 578.014151ms FAIL (2025-07-29 13:29:55 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment... Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment. Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece... Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments... Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil> Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces. Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments... Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil> Duration: 578.045123ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [......XXXX......XXXXX..XXXX...................X.............] duration: 536.025051ms FAIL (2025-07-29 13:29:54 UTC) orbiter warning: uplink: too many requests Duration: 536.091215ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 119.267317ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-07-29 13:29:38 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 119.294212ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 247.39666ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 FAIL (2025-07-29 13:29:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout Duration: 247.425691ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 14 out of 60 is failed (threshold=3) [.......XXXX......XXXXX..XXXX...................X............] duration: 862.875521ms FAIL (2025-07-29 13:29:12 UTC) orbiter warning: uplink: too many requests Duration: 862.902731ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 4.656355848s FAIL (2025-07-29 13:29:02 UTC) orbiter warning: uplink: encryption: context deadline exceeded Duration: 4.656404983s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)