Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 152255 reports (Page 2445 of 3046)
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
244.000653ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:07:10 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 244.047756ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [..............................................X.XX...XX.....]
duration:
1.036209594s
FAIL (2025-07-29 13:06:57 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 1.036239055s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
4.666619094s
FAIL (2025-07-29 13:06:54 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.666652503s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................]
duration:
103.900421ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:06:36 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 103.933456ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
13 out of 60 is failed (threshold=3) [...................................XXXX......XXXXX..XXXX....]
duration:
10.387137759s
FAIL (2025-07-29 13:06:31 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 10.387166685s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
259.82362ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:06:28 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 259.853324ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [...............................................X.XX...XX....]
duration:
12.347291605s
FAIL (2025-07-29 13:06:27 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 12.347312533s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
5.0812648s
FAIL (2025-07-29 13:06:18 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 5.081296897s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
13 out of 60 is failed (threshold=3) [....................................XXXX......XXXXX..XXXX...]
duration:
14.559173862s
FAIL (2025-07-29 13:06:17 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 14.559223917s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration:
104.808762ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:06:15 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 104.835775ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [................................................X.XX...XX...]
duration:
18.520769976s
FAIL (2025-07-29 13:06:06 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 18.520797422s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
234.036992ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:05:59 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 234.085507ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
13 out of 60 is failed (threshold=3) [.....................................XXXX......XXXXX..XXXX..]
duration:
20.081727141s
FAIL (2025-07-29 13:05:50 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 20.081780313s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
127.36197ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:05:32 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 127.408503ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration:
4.641272559s
FAIL (2025-07-29 13:05:25 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.641303228s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [.................................................X.XX...XX..]
duration:
17.804327399s
FAIL (2025-07-29 13:05:24 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 17.804375573s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [..................................................X.XX...XX.]
duration:
43.274381495s
FAIL (2025-07-29 13:05:01 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 43.274406721s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
236.688828ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:04:58 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 236.717857ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
13 out of 60 is failed (threshold=3) [......................................XXXX......XXXXX..XXXX.]
duration:
29.901525461s
FAIL (2025-07-29 13:04:52 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 29.901552059s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
4.610354775s
FAIL (2025-07-29 13:04:45 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.610400657s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
237.793902ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:04:41 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 237.821319ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration:
108.156374ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:04:39 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 108.203931ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
4.636243316s
FAIL (2025-07-29 13:04:28 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.636276017s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration:
99.3928ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:04:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 99.413983ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
262.608825ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:04:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 262.634512ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
5 out of 60 is failed (threshold=3) [...................................................X.XX...XX]
duration:
1m0.003656178s
FAIL (2025-07-29 13:04:18 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145    , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975     , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843     , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776    , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109    , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836     , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278    , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154    , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102    , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134    , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525    , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213    , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326    , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439    , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161    , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357    , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176    , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515    , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 1m0.003683576s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
100.861136ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:03:56 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 100.8857ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
243.020516ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:03:43 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 243.054514ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
13 out of 60 is failed (threshold=3) [.......................................XXXX......XXXXX..XXXX]
duration:
30.003681534s
FAIL (2025-07-29 13:03:41 UTC)
orbiter warning: uplink: context deadline exceeded
Duration: 30.003701834s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................]
duration:
4.576953364s
FAIL (2025-07-29 13:03:41 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.576985135s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
101.946651ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:03:40 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 101.97441ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
4 out of 60 is failed (threshold=3) [....................................................X.XX...X]
duration:
1m0.027440924s
FAIL (2025-07-29 13:03:16 UTC)
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
rting upload
Jul 29 13:02:16.605182793 (20h17m3.426133842s) [upload=19503]: Uploading segments...
Jul 29 13:02:16.605463080 (20h17m3.426414147s) [upload=19503]: Got next segment. Inline: false
Jul 29 13:02:16.605513826 (20h17m3.426464882s) [upload=19503]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:02:16.605527621 (20h17m3.426478678s) [upload=19503]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:02:16.639481678 (20h17m3.460432796s) [seg_pos={0 0}, upload=19503]: Begin upload segment...
Jul 29 13:02:16.639537046 (20h17m3.46048811s) [seg_pos={0 0}, upload=19503]: Done begin upload segment.
Jul 29 13:02:16.639560146 (20h17m3.460511209s) [noise=true , address=104.36.82.13:4198    , piece_id=MW3OTRERTJLSULBA524S5YCOHF3C3TIJMTGQJZZXVZLWQKKAOW3A, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.639589734 (20h17m3.460540797s) [noise=true , address=104.36.82.14:4251    , piece_id=3IID5OQVCNCAPHSX3QEKDQ6XQ3APDWFHATJRAMKVPTIRGFSGTE4Q, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.639896412 (20h17m3.460847477s) [noise=true , address=104.36.82.13:4202    , piece_id=RLREQWLGKBY7JOB4IIBMSW7ELSAARPNWZWLYF5HVARBSB4HUVRIA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.640183722 (20h17m3.46113479s) [noise=true , address=104.36.82.53:4155    , piece_id=SE7XY63UWHYBMV45AWEOHXLERRJ2H5UCDJ567FPASECQBNRUUYHA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.640524515 (20h17m3.461475565s) [noise=true , address=104.36.82.11:4144    , piece_id=TSG47YRC62EIKLOGV5K3E7AFJFHNZT7T6PT2LC75U2YBF526PO5A, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.640804970 (20h17m3.46175603s) [noise=true , address=104.36.82.15:4280    , piece_id=IPCJGMH2FWGFCDHJD7HGUGI44CCKX2S7WTNIJDAX4OR6FXRN6Z2Q, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.641132665 (20h17m3.462083731s) [noise=true , address=104.36.82.47:4541    , piece_id=VP5CX625D7PSSRA44UW5DIMUSFIWV43JOCVPSXF2IS6QDVRY7AJA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.641432794 (20h17m3.462383858s) [noise=true , address=104.36.82.56:4229    , piece_id=GKEMJSGBL77CTEFGGYWYATQPCXT4TELHEHHOUNC7IELAQ4T3A6PA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.641712474 (20h17m3.462663537s) [noise=true , address=104.36.82.8:4989     , piece_id=VGPDSTXCT6HAXPOFGFBCN2EKOCDJH5NTNY3JPSHXJ3CNLWAUK3VA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.641977127 (20h17m3.462928189s) [noise=true , address=104.36.82.55:4222    , piece_id=5WQBVIBAB2S6MY2OW4UQLNG7DOBVH6JHQJPH6Z5PR7QRN4YWUZ3Q, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.643565485 (20h17m3.464516551s) [noise=true , address=104.36.82.42:4803    , piece_id=O4MXQ5KETSBIZLYOHXUW77D6V6XRDBDN27N4UM55RHQS2ACCGNHQ, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.643886229 (20h17m3.464837289s) [noise=true , address=104.36.82.22:4532    , piece_id=PGL2XYHVBW5VW32FPGEM54N55XSOA5RGQ6ARHWGNRQTELH4PXQSQ, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.644230751 (20h17m3.465181813s) [noise=true , address=104.36.82.10:4080    , piece_id=QHQEUHD63LI4EK4VYMDC3WGSHA3H25VNXK6GVHOE6TSMKNJUVLKA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.644624455 (20h17m3.465575523s) [noise=true , address=104.36.82.36:4621    , piece_id=YDWSCWUQAYJY32TUPNHLNZOUEFTLRTQCCDPQOQBNI4WOQKJ62RTA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.644952855 (20h17m3.465903903s) [noise=true , address=104.36.82.12:4155    , piece_id=C5FI72ON45KUQGKMZTLLA7FD3CNJQKSMR4J5SFVD2BUX6CBJEQ2A, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.645226660 (20h17m3.466177794s) [noise=true , address=104.36.82.46:4485    , piece_id=SD46TC7SVEFKVSW73KUS4O33OHNY7JOBQ4ZE4HOZHFQMFZWZ45QQ, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.645534561 (20h17m3.466485627s) [noise=true , address=104.36.82.47:4548    , piece_id=3IWWIFG3GRPS5GXJTTCOAHMZ7ZSF5ZQH57W5M27Y2YLENVGCC2EA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.645838651 (20h17m3.466789715s) [noise=true , address=104.36.82.50:4041    , piece_id=IKFQMNKAT5QIZ3YFLR46I3SIATMLWBXCFJXKXD4LQGB75ZSF4WYA, seg_pos={0 0}, upload=19503]: Uploading piece...
Jul 29 13:02:16.734678099 (20h17m3.555629146s) [upload=19503]: Next returned nil segment
Jul 29 13:02:16.734695895 (20h17m3.555646955s) [upload=19503]: Waiting for error group managing segments...
Jul 29 13:02:16.746775981 (20h17m3.567727038s) [noise=true , address=104.36.82.36:4621    , piece_id=YDWSCWUQAYJY32TUPNHLNZOUEFTLRTQCCDPQOQBNI4WOQKJ62RTA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:16.759136328 (20h17m3.580087385s) [noise=true , address=104.36.82.15:4280    , piece_id=IPCJGMH2FWGFCDHJD7HGUGI44CCKX2S7WTNIJDAX4OR6FXRN6Z2Q, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:17.743916488 (20h17m4.564867541s) [noise=true , address=104.36.82.56:4229    , piece_id=GKEMJSGBL77CTEFGGYWYATQPCXT4TELHEHHOUNC7IELAQ4T3A6PA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:17.744144121 (20h17m4.565095181s) [noise=true , address=104.36.82.13:4198    , piece_id=MW3OTRERTJLSULBA524S5YCOHF3C3TIJMTGQJZZXVZLWQKKAOW3A, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:18.027233565 (20h17m4.84818461s) [noise=true , address=104.36.82.13:4202    , piece_id=RLREQWLGKBY7JOB4IIBMSW7ELSAARPNWZWLYF5HVARBSB4HUVRIA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:20.354502187 (20h17m7.175453237s) [noise=true , address=104.36.82.50:4041    , piece_id=IKFQMNKAT5QIZ3YFLR46I3SIATMLWBXCFJXKXD4LQGB75ZSF4WYA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:24.022582748 (20h17m10.843533794s) [noise=true , address=104.36.82.14:4251    , piece_id=3IID5OQVCNCAPHSX3QEKDQ6XQ3APDWFHATJRAMKVPTIRGFSGTE4Q, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:24.092247822 (20h17m10.913198891s) [noise=true , address=104.36.82.8:4989     , piece_id=VGPDSTXCT6HAXPOFGFBCN2EKOCDJH5NTNY3JPSHXJ3CNLWAUK3VA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:24.568030265 (20h17m11.388981315s) [noise=true , address=104.36.82.12:4155    , piece_id=C5FI72ON45KUQGKMZTLLA7FD3CNJQKSMR4J5SFVD2BUX6CBJEQ2A, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:25.324577010 (20h17m12.145528059s) [noise=true , address=104.36.82.22:4532    , piece_id=PGL2XYHVBW5VW32FPGEM54N55XSOA5RGQ6ARHWGNRQTELH4PXQSQ, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:33.787638351 (20h17m20.608589413s) [noise=true , address=104.36.82.53:4155    , piece_id=SE7XY63UWHYBMV45AWEOHXLERRJ2H5UCDJ567FPASECQBNRUUYHA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:48.339552791 (20h17m35.16050384s) [noise=true , address=104.36.82.11:4144    , piece_id=TSG47YRC62EIKLOGV5K3E7AFJFHNZT7T6PT2LC75U2YBF526PO5A, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:02:58.983376038 (20h17m45.804327101s) [noise=true , address=104.36.82.10:4080    , piece_id=QHQEUHD63LI4EK4VYMDC3WGSHA3H25VNXK6GVHOE6TSMKNJUVLKA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: <nil>
Jul 29 13:03:16.576004774 (20h18m3.396955832s) [noise=true , address=104.36.82.46:4485    , piece_id=SD46TC7SVEFKVSW73KUS4O33OHNY7JOBQ4ZE4HOZHFQMFZWZ45QQ, seg_pos={0 0}, upload=19503]: Done uploading piece. err: ecclient: upload failed (node:12w74nT4D4F3tttRavcoKiPzyct4CxvGQfbn6EcVypHzaexCxNJ, address:104.36.82.46:4485): protocol: rpc: dial tcp 104.36.82.46:4485: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:03:16.576302242 (20h18m3.397253306s) [noise=true , address=104.36.82.55:4222    , piece_id=5WQBVIBAB2S6MY2OW4UQLNG7DOBVH6JHQJPH6Z5PR7QRN4YWUZ3Q, seg_pos={0 0}, upload=19503]: Done uploading piece. err: ecclient: upload failed (node:12ZKW35KvrsoYRefbYeUFZo8bh4XZYycNKGEvTFjzibezjXgj3e, address:104.36.82.55:4222): protocol: write tcp 159.223.143.39:37534->104.36.82.55:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:03:16.576339982 (20h18m3.397291044s) [noise=true , address=104.36.82.47:4548    , piece_id=3IWWIFG3GRPS5GXJTTCOAHMZ7ZSF5ZQH57W5M27Y2YLENVGCC2EA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: ecclient: upload failed (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT, address:104.36.82.47:4548): protocol: rpc: dial tcp 104.36.82.47:4548: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:03:16.576393963 (20h18m3.397345024s) [noise=true , address=104.36.82.47:4541    , piece_id=VP5CX625D7PSSRA44UW5DIMUSFIWV43JOCVPSXF2IS6QDVRY7AJA, seg_pos={0 0}, upload=19503]: Done uploading piece. err: ecclient: upload failed (node:1m1ED9th2QhuoxBKEo3Dync9GpkWjGYNTSBHd57ud2BJoH3HXC, address:104.36.82.47:4541): protocol: rpc: dial tcp 104.36.82.47:4541: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:03:16.576450069 (20h18m3.397401129s) [noise=true , address=104.36.82.42:4803    , piece_id=O4MXQ5KETSBIZLYOHXUW77D6V6XRDBDN27N4UM55RHQS2ACCGNHQ, seg_pos={0 0}, upload=19503]: Done uploading piece. err: ecclient: upload failed (node:12GFk3GkhB88UKQdZM8vZ9VLNuuYDrS5ThZjVAdbL2CtTQVMDEB, address:104.36.82.42:4803): protocol: read tcp 159.223.143.39:46822->104.36.82.42:4803: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:03:16.576473650 (20h18m3.397424718s) [seg_pos={0 0}, upload=19503]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul 29 13:03:16.600515030 (20h18m3.421466086s) [upload=19503]: Done uploading segments...
Jul 29 13:03:16.600546505 (20h18m3.421497566s) [upload=19503]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.02746201s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
12 out of 60 is failed (threshold=3) [........................................XXXX......XXXXX..XXX]
duration:
30.038499106s
FAIL (2025-07-29 13:03:11 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 30.038511859s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
99.830444ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:03:09 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 99.856748ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
243.137517ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:02:51 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 243.161407ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration:
4.555918492s
FAIL (2025-07-29 13:02:50 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.555947111s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
11 out of 60 is failed (threshold=3) [.........................................XXXX......XXXXX..XX]
duration:
30.036442377s
FAIL (2025-07-29 13:02:41 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 30.036471369s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
108.190174ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:02:33 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 108.221347ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [.....................................................X.XX...]
duration:
57.626287765s
FAIL (2025-07-29 13:02:16 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
]: Got next segment. Inline: false
Jul 29 12:58:01.067631265 (20h12m47.888582309s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:58:01.067638616 (20h12m47.888589678s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:58:01.108360560 (20h12m47.929311626s) [seg_pos={0 0}, upload=19438]: Begin upload segment...
Jul 29 12:58:01.108434877 (20h12m47.929385942s) [seg_pos={0 0}, upload=19438]: Done begin upload segment.
Jul 29 12:58:01.108485985 (20h12m47.929437164s) [noise=true , address=104.36.82.13:4218    , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109180766 (20h12m47.93013183s) [noise=true , address=104.36.82.12:4158    , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109593695 (20h12m47.930544789s) [noise=true , address=104.36.82.14:4245    , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109991546 (20h12m47.930942613s) [noise=true , address=104.36.82.21:4504    , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110477127 (20h12m47.931428197s) [noise=true , address=104.36.82.55:4223    , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110878656 (20h12m47.931829726s) [noise=true , address=104.36.82.11:4140    , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111297836 (20h12m47.932248898s) [noise=true , address=104.36.82.5:4855     , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111640483 (20h12m47.932591549s) [noise=true , address=104.36.82.10:4090    , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112060105 (20h12m47.933011171s) [noise=true , address=104.36.82.51:4061    , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112413667 (20h12m47.933364735s) [noise=true , address=104.36.82.15:4292    , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112763523 (20h12m47.933714589s) [noise=true , address=104.36.82.52:4098    , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113103407 (20h12m47.934054473s) [noise=true , address=104.36.82.42:4797    , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113472834 (20h12m47.934423894s) [noise=true , address=104.36.82.47:4531    , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113833742 (20h12m47.934784804s) [noise=true , address=104.36.82.54:4178    , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114185899 (20h12m47.935136964s) [noise=true , address=104.36.82.43:4844    , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114563217 (20h12m47.935514281s) [noise=true , address=104.36.82.4:4831     , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114924389 (20h12m47.935875455s) [noise=true , address=104.36.82.46:4495    , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.115342212 (20h12m47.936293277s) [noise=true , address=104.36.82.56:4242    , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.220083974 (20h12m48.041035034s) [upload=19438]: Next returned nil segment
Jul 29 12:58:01.220114559 (20h12m48.041065865s) [upload=19438]: Waiting for error group managing segments...
Jul 29 12:58:01.227401017 (20h12m48.048352076s) [noise=true , address=104.36.82.54:4178    , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.228063673 (20h12m48.049014733s) [noise=true , address=104.36.82.56:4242    , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.230715332 (20h12m48.051666391s) [noise=true , address=104.36.82.4:4831     , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.231360975 (20h12m48.052312039s) [noise=true , address=104.36.82.14:4245    , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.233993105 (20h12m48.054944164s) [noise=true , address=104.36.82.12:4158    , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.241297750 (20h12m48.0622488s) [noise=true , address=104.36.82.52:4098    , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.376716761 (20h12m48.197667813s) [noise=true , address=104.36.82.43:4844    , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:02.335253199 (20h12m49.156204243s) [noise=true , address=104.36.82.55:4223    , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:03.043981725 (20h12m49.864932787s) [noise=true , address=104.36.82.47:4531    , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:16.529700154 (20h13m3.350651197s) [noise=true , address=104.36.82.5:4855     , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:24.897864107 (20h13m11.718815157s) [noise=true , address=104.36.82.51:4061    , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:28.624160601 (20h13m15.445111653s) [noise=true , address=104.36.82.21:4504    , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:30.701079139 (20h13m17.522030188s) [noise=true , address=104.36.82.42:4797    , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335400027 (20h13m24.156351085s) [noise=true , address=104.36.82.11:4140    , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335427046 (20h13m24.156378105s) [seg_pos={0 0}, upload=19438]: Segment reached optimal threshold of 14 pieces.
Jul 29 12:58:37.336491848 (20h13m24.157442906s) [noise=true , address=104.36.82.15:4292    , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: rpc: dial tcp 104.36.82.15:4292: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336583451 (20h13m24.157534508s) [noise=true , address=104.36.82.13:4218    , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: rpc: dial tcp 104.36.82.13:4218: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336636556 (20h13m24.157587613s) [noise=true , address=104.36.82.10:4090    , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB): protocol: rpc: dial tcp 104.36.82.10:4090: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336688139 (20h13m24.157639196s) [noise=true , address=104.36.82.46:4495    , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YpHarCJ3ouMGTs59udhU7az9h68ELEHTa2aTAax2chR2Gux1x): protocol: write tcp 159.223.143.39:58718->104.36.82.46:4495: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336699045 (20h13m24.157650088s) [seg_pos={0 0}, upload=19438]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 12:58:37.336775276 (20h13m24.157726332s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 12:58:37.336779211 (20h13m24.157730254s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 12:58:37.397080471 (20h13m24.218031536s) [upload=19438]: Done uploading segments...
Jul 29 12:58:37.397103349 (20h13m24.218054409s) [upload=19438]: Upload finished. err: <nil>
Duration: 57.62632343s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
678.12234ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:02:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 678.143686ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
4.563192384s
FAIL (2025-07-29 13:01:56 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.563222638s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
10 out of 60 is failed (threshold=3) [..........................................XXXX......XXXXX..X]
duration:
30.035565559s
FAIL (2025-07-29 13:01:43 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 30.035594389s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
147.615053ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:01:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 147.644549ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
237.376045ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:01:11 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 237.404837ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
4.498658738s
FAIL (2025-07-29 13:00:54 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.49870645s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [......................................................X.XX..]
duration:
32.008312792s
FAIL (2025-07-29 13:00:42 UTC)
======ERROR======
uplink: context deadline exceeded
======LOGS======
]: Got next segment. Inline: false
Jul 29 12:58:01.067631265 (20h12m47.888582309s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 12:58:01.067638616 (20h12m47.888589678s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 12:58:01.108360560 (20h12m47.929311626s) [seg_pos={0 0}, upload=19438]: Begin upload segment...
Jul 29 12:58:01.108434877 (20h12m47.929385942s) [seg_pos={0 0}, upload=19438]: Done begin upload segment.
Jul 29 12:58:01.108485985 (20h12m47.929437164s) [noise=true , address=104.36.82.13:4218    , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109180766 (20h12m47.93013183s) [noise=true , address=104.36.82.12:4158    , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109593695 (20h12m47.930544789s) [noise=true , address=104.36.82.14:4245    , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.109991546 (20h12m47.930942613s) [noise=true , address=104.36.82.21:4504    , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110477127 (20h12m47.931428197s) [noise=true , address=104.36.82.55:4223    , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.110878656 (20h12m47.931829726s) [noise=true , address=104.36.82.11:4140    , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111297836 (20h12m47.932248898s) [noise=true , address=104.36.82.5:4855     , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.111640483 (20h12m47.932591549s) [noise=true , address=104.36.82.10:4090    , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112060105 (20h12m47.933011171s) [noise=true , address=104.36.82.51:4061    , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112413667 (20h12m47.933364735s) [noise=true , address=104.36.82.15:4292    , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.112763523 (20h12m47.933714589s) [noise=true , address=104.36.82.52:4098    , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113103407 (20h12m47.934054473s) [noise=true , address=104.36.82.42:4797    , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113472834 (20h12m47.934423894s) [noise=true , address=104.36.82.47:4531    , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.113833742 (20h12m47.934784804s) [noise=true , address=104.36.82.54:4178    , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114185899 (20h12m47.935136964s) [noise=true , address=104.36.82.43:4844    , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114563217 (20h12m47.935514281s) [noise=true , address=104.36.82.4:4831     , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.114924389 (20h12m47.935875455s) [noise=true , address=104.36.82.46:4495    , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.115342212 (20h12m47.936293277s) [noise=true , address=104.36.82.56:4242    , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Uploading piece...
Jul 29 12:58:01.220083974 (20h12m48.041035034s) [upload=19438]: Next returned nil segment
Jul 29 12:58:01.220114559 (20h12m48.041065865s) [upload=19438]: Waiting for error group managing segments...
Jul 29 12:58:01.227401017 (20h12m48.048352076s) [noise=true , address=104.36.82.54:4178    , piece_id=LNRSUVHXT2OZWG2SG65AOE34LKRBEFVSQP576NYV4G7OTI2FBE3Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.228063673 (20h12m48.049014733s) [noise=true , address=104.36.82.56:4242    , piece_id=DHO2PL36INEQOYSYKGYHGCTGYJR7V7TBO5TRK5D6W5OE7FIBJ7KQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.230715332 (20h12m48.051666391s) [noise=true , address=104.36.82.4:4831     , piece_id=UQNKKSPZ24AIATEQWNMSDO6Q5JVM734FLO3MDTG3GCB5XB5FSYPQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.231360975 (20h12m48.052312039s) [noise=true , address=104.36.82.14:4245    , piece_id=644PPPCL437WEHXHYCXECCRR4FETOY5ZLFIK5YURKZBZIJ65KUTA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.233993105 (20h12m48.054944164s) [noise=true , address=104.36.82.12:4158    , piece_id=DHPGGM44LHOSCI2SYNE5VFWFVAZDGOMD6FSHOUDGKJB32X6TR4IA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.241297750 (20h12m48.0622488s) [noise=true , address=104.36.82.52:4098    , piece_id=VLOKEQC7RQ6VYIT4TSES3F4GQJKCEZIJTTSSM3URPANWMY66R3ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:01.376716761 (20h12m48.197667813s) [noise=true , address=104.36.82.43:4844    , piece_id=6EVSLFKGL7K3QV6VZ52KIFXFSZA7PFQL2C2GQYL5YV2TQI45IAMQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:02.335253199 (20h12m49.156204243s) [noise=true , address=104.36.82.55:4223    , piece_id=TXNFLXUKYIQVOPBUVCCQPGCMDG526DTPLMWIH7D42MUL6E4AFNUQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:03.043981725 (20h12m49.864932787s) [noise=true , address=104.36.82.47:4531    , piece_id=PM4KZEASQP2PHGMLB7RDEJ6W53EFCBHJ5EBJTMVTZAI2KEMR5XXQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:16.529700154 (20h13m3.350651197s) [noise=true , address=104.36.82.5:4855     , piece_id=ZGVSGGO5COBXYE344VOMLX3LPARY2JACW4PM2WKKO7C53QIEL6ZQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:24.897864107 (20h13m11.718815157s) [noise=true , address=104.36.82.51:4061    , piece_id=OGZEFHUSKEVGZKH7S67UXSCWF6VGF7WIZI33P6DZC6ZW3TPPKO7Q, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:28.624160601 (20h13m15.445111653s) [noise=true , address=104.36.82.21:4504    , piece_id=FVW7GW4BDDJKXGP722XE2Z4QEGNAJUVSC4RYWZUPHQLXAWECUOZA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:30.701079139 (20h13m17.522030188s) [noise=true , address=104.36.82.42:4797    , piece_id=BT4ULXH44YJKTV7PPT43OGNPH36DEVUHDBXBTSIS7VGSGTRJKKYQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335400027 (20h13m24.156351085s) [noise=true , address=104.36.82.11:4140    , piece_id=TM4AGHUWT6BUJK2WNKIL3VVDBKIPIQVCJXNGM64PC7RQGMOHEJ5A, seg_pos={0 0}, upload=19438]: Done uploading piece. err: <nil>
Jul 29 12:58:37.335427046 (20h13m24.156378105s) [seg_pos={0 0}, upload=19438]: Segment reached optimal threshold of 14 pieces.
Jul 29 12:58:37.336491848 (20h13m24.157442906s) [noise=true , address=104.36.82.15:4292    , piece_id=NWYV5IFHAS2BNNXQZLIXIML6UVF7KD6WU3VTJ24HYC6GIXWQY4MA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UpWmMhEmk5veKZvzsQ3MCxCMnfEKtFgCugBTsYfy9Ejm7G4xD): protocol: rpc: dial tcp 104.36.82.15:4292: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336583451 (20h13m24.157534508s) [noise=true , address=104.36.82.13:4218    , piece_id=6IEJUUFTV4VLL5Y524APFK6IEXVBUYXGOMT76X4YH65WK6RAQWOA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mbzxg1BjmbXeHxGgheZmQoN91k8NgaAUUASPkJe3fEmS4eEkc): protocol: rpc: dial tcp 104.36.82.13:4218: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336636556 (20h13m24.157587613s) [noise=true , address=104.36.82.10:4090    , piece_id=UTZZUICUGGY4UJDPKMCECJAEUZPEMIY7TZMOLJQUJV3NKXOIO3OA, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qSkJk9HUyQon3UP1AA8mRcqJbNdkKJh6cEUZoHLGNniqDvNqB): protocol: rpc: dial tcp 104.36.82.10:4090: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336688139 (20h13m24.157639196s) [noise=true , address=104.36.82.46:4495    , piece_id=RZQECGTO6ITXL65JRUMFD2FC262ICQGHFREK2CMNZ3GBIZI3N2CQ, seg_pos={0 0}, upload=19438]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YpHarCJ3ouMGTs59udhU7az9h68ELEHTa2aTAax2chR2Gux1x): protocol: write tcp 159.223.143.39:58718->104.36.82.46:4495: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 12:58:37.336699045 (20h13m24.157650088s) [seg_pos={0 0}, upload=19438]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 12:58:37.336775276 (20h13m24.157726332s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 12:58:37.336779211 (20h13m24.157730254s) [upload=19438]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 12:58:37.397080471 (20h13m24.218031536s) [upload=19438]: Done uploading segments...
Jul 29 12:58:37.397103349 (20h13m24.218054409s) [upload=19438]: Upload finished. err: <nil>
Duration: 32.008344443s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
129.446061ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:00:37 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 129.475036ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
244.927501ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:00:25 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 245.025426ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
9 out of 60 is failed (threshold=3) [...........................................XXXX......XXXXX..]
duration:
22.449268278s
FAIL (2025-07-29 13:00:24 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 22.449289444s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
9 out of 60 is failed (threshold=3) [............................................XXXX......XXXXX.]
duration:
24.623993508s
FAIL (2025-07-29 13:00:01 UTC)
orbiter warning: uplink: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 24.624065344s core uplink us-select-1 us1-placement-20