Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
98.683889ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:21:44 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 98.712757ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [.................XXXX......XXXXX..XXXX...................X..] duration:
1.06830109s
FAIL (2025-07-29 13:21:33 UTC)
orbiter warning: uplink: too many requests
Duration: 1.068326109s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
277.062862ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:21:26 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 277.09337ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..........................X.XX...XX.........................] duration:
652.0494ms
FAIL (2025-07-29 13:21:25 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 652.077037ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
4.650927695s
FAIL (2025-07-29 13:21:15 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.650963976s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...........................X.XX...XX........................] duration:
890.262278ms
FAIL (2025-07-29 13:20:56 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 890.2909ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
132.502969ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:20:56 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 132.531335ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.683017644s
FAIL (2025-07-29 13:20:46 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.683042438s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [..................XXXX......XXXXX..XXXX...................X.] duration:
918.5904ms
FAIL (2025-07-29 13:20:43 UTC)
orbiter warning: uplink: too many requests
Duration: 918.641644ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [............................X.XX...XX.......................] duration:
673.1849ms
FAIL (2025-07-29 13:20:31 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 673.21553ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
237.905962ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:20:28 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 237.93662ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.705899497s
FAIL (2025-07-29 13:20:14 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.705935559s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
115.476517ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:20:13 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 115.499923ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [...................XXXX......XXXXX..XXXX...................X] duration:
40.856467ms
FAIL (2025-07-29 13:20:12 UTC)
orbiter warning: uplink: too many requests
Duration: 40.954848ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.68423494s
FAIL (2025-07-29 13:19:54 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.684262578s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [....................XXXX......XXXXX..XXXX...................] duration:
723.369839ms
FAIL (2025-07-29 13:19:37 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 723.417849ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
668.21721ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:19:31 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 668.245402ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.............................X.XX...XX......................] duration:
632.024061ms
FAIL (2025-07-29 13:19:27 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 632.060264ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
102.31722ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:19:13 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 102.346725ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.61162002s
FAIL (2025-07-29 13:19:12 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.611647059s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
683.215998ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:19:11 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 683.240365ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
4.489825029s
FAIL (2025-07-29 13:18:48 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.489901927s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..............................X.XX...XX.....................] duration:
675.854024ms
FAIL (2025-07-29 13:18:42 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 675.88221ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [.....................XXXX......XXXXX..XXXX..................] duration:
796.821694ms
FAIL (2025-07-29 13:18:30 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 796.849094ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
97.745916ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:18:23 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 97.771981ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
4.537104688s
FAIL (2025-07-29 13:18:21 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.537132761s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
244.570996ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:18:14 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 244.629771ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
4.752153031s
FAIL (2025-07-29 13:18:06 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.752184063s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...............................X.XX...XX....................] duration:
787.475606ms
FAIL (2025-07-29 13:18:03 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 787.541142ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
4.651716494s
FAIL (2025-07-29 13:17:35 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.651752148s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
112.274807ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:17:35 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 112.299131ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [................................X.XX...XX...................] duration:
660.770916ms
FAIL (2025-07-29 13:17:33 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 660.7994ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
278.459223ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:17:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 278.491635ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [......................XXXX......XXXXX..XXXX.................] duration:
787.21949ms
FAIL (2025-07-29 13:17:19 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 787.257803ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
105.917249ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:17:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 105.945885ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
4.583892367s
FAIL (2025-07-29 13:16:56 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.583927731s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [.......................XXXX......XXXXX..XXXX................] duration:
642.273339ms
FAIL (2025-07-29 13:16:32 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 642.30318ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.................................X.XX...XX..................] duration:
1.063443219s
FAIL (2025-07-29 13:16:26 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 1.063468614s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
103.819561ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:16:22 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 103.857373ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
236.754801ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:16:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 236.794699ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
244.474659ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:16:03 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 244.522103ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
4.646571722s
FAIL (2025-07-29 13:15:58 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.646599698s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..................................X.XX...XX.................] duration:
750.533453ms
FAIL (2025-07-29 13:15:57 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 750.561486ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
104.783311ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:15:44 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 104.812327ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
113.694526ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:15:29 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 113.714983ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...................................X.XX...XX................] duration:
1.007196155s
FAIL (2025-07-29 13:15:22 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 1.007224938s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [........................XXXX......XXXXX..XXXX...............] duration:
1.371709202s
FAIL (2025-07-29 13:15:22 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 1.371740397s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
686.271175ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:15:05 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 686.292601ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
100.738348ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:14:58 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 100.770766ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
13 out of 60 is failed (threshold=3) [.........................XXXX......XXXXX..XXXX..............] duration:
959.571281ms
FAIL (2025-07-29 13:14:48 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 959.604719ms
core
uplink
us-select-1
us1-placement-20
|