Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
4.652169956s
FAIL (2025-07-29 13:14:48 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.652202522s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [....................................X.XX...XX...............] duration:
816.689417ms
FAIL (2025-07-29 13:14:44 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 816.71837ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
4.678047656s
FAIL (2025-07-29 13:14:22 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.678076292s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.....................................X.XX...XX..............] duration:
863.300953ms
FAIL (2025-07-29 13:13:59 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 863.336936ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
113.234339ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:13:59 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 113.263282ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
255.202053ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:13:59 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 255.229106ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [..........................XXXX......XXXXX..XXXX.............] duration:
722.273789ms
FAIL (2025-07-29 13:13:57 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 722.305706ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
4.713070741s
FAIL (2025-07-29 13:13:38 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.713103455s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
235.735175ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:13:17 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 235.758247ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
99.477763ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:13:16 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 99.49621ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [......................................X.XX...XX.............] duration:
1.713669354s
FAIL (2025-07-29 13:12:55 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 1.713702999s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
240.240955ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:12:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 240.264148ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
241.756222ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:12:50 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 241.782364ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [...........................XXXX......XXXXX..XXXX............] duration:
516.229049ms
FAIL (2025-07-29 13:12:47 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 516.258562ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
4.720334362s
FAIL (2025-07-29 13:12:42 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.720363286s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.......................................X.XX...XX............] duration:
519.042ms
FAIL (2025-07-29 13:12:17 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 519.073525ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
100.970747ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:11:59 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 100.99349ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.725032486s
FAIL (2025-07-29 13:11:54 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.725090404s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
245.044644ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:11:53 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 245.082648ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [............................XXXX......XXXXX..XXXX...........] duration:
635.69937ms
FAIL (2025-07-29 13:11:51 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 635.732621ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [........................................X.XX...XX...........] duration:
636.406392ms
FAIL (2025-07-29 13:11:30 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 636.461063ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
102.444813ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:11:29 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 102.46274ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.618217874s
FAIL (2025-07-29 13:11:21 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.618246364s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
245.200464ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:11:08 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 245.226909ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [.............................XXXX......XXXXX..XXXX..........] duration:
500.506348ms
FAIL (2025-07-29 13:10:54 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 500.536625ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.........................................X.XX...XX..........] duration:
708.11468ms
FAIL (2025-07-29 13:10:24 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 708.152071ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
138.300582ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:10:23 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 138.326156ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
246.385815ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:10:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 246.412587ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.909903639s
FAIL (2025-07-29 13:10:19 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.909942062s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [..............................XXXX......XXXXX..XXXX.........] duration:
1.769590656s
FAIL (2025-07-29 13:10:12 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 1.769620289s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
143.931095ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:09:30 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 144.028908ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [...............................XXXX......XXXXX..XXXX........] duration:
937.856345ms
FAIL (2025-07-29 13:09:29 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 937.904162ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.618050904s
FAIL (2025-07-29 13:09:29 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.61808535s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
684.545908ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:09:29 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 684.565785ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..........................................X.XX...XX.........] duration:
742.640761ms
FAIL (2025-07-29 13:09:28 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 742.692147ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...........................................X.XX...XX........] duration:
773.642109ms
FAIL (2025-07-29 13:09:01 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 773.697135ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.681380091s
FAIL (2025-07-29 13:09:01 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.681408226s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
237.794913ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:09:00 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 237.829581ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
107.449497ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:08:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 107.477797ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [............................................X.XX...XX.......] duration:
656.500476ms
FAIL (2025-07-29 13:08:40 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 656.528393ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
184.423323ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:08:25 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 184.451351ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [................................XXXX......XXXXX..XXXX.......] duration:
1.303871492s
FAIL (2025-07-29 13:08:21 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 1.303904017s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.658492686s
FAIL (2025-07-29 13:08:07 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.658523857s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [.................................XXXX......XXXXX..XXXX......] duration:
1.359606986s
FAIL (2025-07-29 13:07:53 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 1.359635261s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
110.843668ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:07:53 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 110.986535ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
239.867486ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:07:50 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 239.905536ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.............................................X.XX...XX......] duration:
843.508101ms
FAIL (2025-07-29 13:07:33 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 843.557377ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
100.937801ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:07:31 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 100.968494ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
254.715357ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:07:29 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 254.742069ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [..................................XXXX......XXXXX..XXXX.....] duration:
948.535887ms
FAIL (2025-07-29 13:07:28 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 948.562269ms
core
uplink
us-select-1
us1-placement-20
|