Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
103.319193ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:28:56 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 103.343024ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
273.522787ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:28:53 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 273.552651ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [................X.XX...XX...................................] duration:
707.398404ms
FAIL (2025-07-29 13:28:42 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 707.430476ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [........XXXX......XXXXX..XXXX...................X...........] duration:
654.250116ms
FAIL (2025-07-29 13:28:24 UTC)
orbiter warning: uplink: too many requests
Duration: 654.281446ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
240.636469ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:28:15 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 240.668018ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
4.790026245s
FAIL (2025-07-29 13:28:08 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.790078895s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [.........XXXX......XXXXX..XXXX...................X..........] duration:
761.119317ms
FAIL (2025-07-29 13:28:07 UTC)
orbiter warning: uplink: too many requests
Duration: 761.153376ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
108.971706ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:28:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 108.999184ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.................X.XX...XX..................................] duration:
657.13126ms
FAIL (2025-07-29 13:27:56 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 657.162918ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
4.60965565s
FAIL (2025-07-29 13:27:37 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.609699915s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
240.319638ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:27:36 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 240.350389ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [..................X.XX...XX.................................] duration:
942.148421ms
FAIL (2025-07-29 13:27:26 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 942.180135ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
4.595202596s
FAIL (2025-07-29 13:27:11 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.595382331s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
101.713275ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:27:11 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 101.739973ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [..........XXXX......XXXXX..XXXX...................X.........] duration:
545.689561ms
FAIL (2025-07-29 13:27:08 UTC)
orbiter warning: uplink: too many requests
Duration: 545.722045ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
246.57225ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:27:07 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 246.602009ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
4.788448159s
FAIL (2025-07-29 13:26:51 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.788485472s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [...........XXXX......XXXXX..XXXX...................X........] duration:
819.802926ms
FAIL (2025-07-29 13:26:43 UTC)
orbiter warning: uplink: too many requests
Duration: 819.840529ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
103.801351ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:26:37 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 103.828811ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [...................X.XX...XX................................] duration:
793.202707ms
FAIL (2025-07-29 13:26:31 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 793.240088ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
4.584431809s
FAIL (2025-07-29 13:26:27 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.584460028s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
680.140733ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:26:07 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 680.227413ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [............XXXX......XXXXX..XXXX...................X.......] duration:
702.557544ms
FAIL (2025-07-29 13:25:58 UTC)
orbiter warning: uplink: too many requests
Duration: 702.59691ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
108.481456ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:25:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 108.505608ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [....................X.XX...XX...............................] duration:
621.365958ms
FAIL (2025-07-29 13:25:36 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 621.40129ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
4.665314472s
FAIL (2025-07-29 13:25:34 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.665345486s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [.............XXXX......XXXXX..XXXX...................X......] duration:
750.762312ms
FAIL (2025-07-29 13:25:22 UTC)
orbiter warning: uplink: too many requests
Duration: 750.790565ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.....................X.XX...XX..............................] duration:
543.012046ms
FAIL (2025-07-29 13:25:12 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 543.040741ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
107.478412ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:25:10 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 107.603378ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
245.393103ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:24:55 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 245.421063ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
4.62704179s
FAIL (2025-07-29 13:24:40 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.627073018s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [..............XXXX......XXXXX..XXXX...................X.....] duration:
819.427601ms
FAIL (2025-07-29 13:24:26 UTC)
orbiter warning: uplink: too many requests
Duration: 819.464659ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
240.748485ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:24:22 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 240.782865ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [......................X.XX...XX.............................] duration:
822.291709ms
FAIL (2025-07-29 13:24:10 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 822.335395ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
113.341826ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:24:10 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 113.37017ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
4.744468729s
FAIL (2025-07-29 13:24:05 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.7445022s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
4.694765443s
FAIL (2025-07-29 13:23:49 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.694845858s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.......................X.XX...XX............................] duration:
610.103526ms
FAIL (2025-07-29 13:23:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 610.137367ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
101.158666ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:23:42 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 101.180779ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [...............XXXX......XXXXX..XXXX...................X....] duration:
486.066585ms
FAIL (2025-07-29 13:23:30 UTC)
orbiter warning: uplink: too many requests
Duration: 486.146071ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
4.674316926s
FAIL (2025-07-29 13:23:29 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.674346545s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
99.593988ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:23:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 99.619808ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
239.272588ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:23:13 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 239.295609ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [........................X.XX...XX...........................] duration:
458.749615ms
FAIL (2025-07-29 13:23:09 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 458.778607ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
4.640201758s
FAIL (2025-07-29 13:22:40 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.640232798s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
149.049803ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-29 13:22:35 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 149.086675ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
14 out of 60 is failed (threshold=3) [................XXXX......XXXXX..XXXX...................X...] duration:
741.003265ms
FAIL (2025-07-29 13:22:28 UTC)
orbiter warning: uplink: too many requests
Duration: 741.104672ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
245.864626ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-29 13:22:22 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49980->127.0.0.1:53: i/o timeout
Duration: 245.897056ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
5 out of 60 is failed (threshold=3) [.........................X.XX...XX..........................] duration:
707.270285ms
FAIL (2025-07-29 13:22:18 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
20h18m5.080650592s) [upload=19520]: Got next segment. Inline: false
Jul 29 13:03:18.259752922 (20h18m5.08070398s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 29 13:03:18.259776742 (20h18m5.080727799s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 29 13:03:18.307367357 (20h18m5.128318425s) [seg_pos={0 0}, upload=19520]: Begin upload segment...
Jul 29 13:03:18.307440285 (20h18m5.12839135s) [seg_pos={0 0}, upload=19520]: Done begin upload segment.
Jul 29 13:03:18.307495433 (20h18m5.128446489s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307512450 (20h18m5.128463517s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.307949419 (20h18m5.128900481s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308037550 (20h18m5.128988617s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308271844 (20h18m5.129222906s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308459354 (20h18m5.129410397s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308610838 (20h18m5.129561923s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.308962829 (20h18m5.129913896s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309312659 (20h18m5.130263726s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309684791 (20h18m5.130635859s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.309978301 (20h18m5.130929369s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310489741 (20h18m5.131440811s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.310900148 (20h18m5.131851216s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311175152 (20h18m5.132126219s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311564263 (20h18m5.132515325s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.311945490 (20h18m5.132896549s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312085645 (20h18m5.133036715s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.312521687 (20h18m5.133472753s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Uploading piece...
Jul 29 13:03:18.402353188 (20h18m5.223304259s) [upload=19520]: Next returned nil segment
Jul 29 13:03:18.402375156 (20h18m5.223326225s) [upload=19520]: Waiting for error group managing segments...
Jul 29 13:03:18.426996928 (20h18m5.247947988s) [noise=true , address=104.36.82.53:4145 , piece_id=SO4DBYGA5VJYCR4AD5DHKML7RXD5QEGY6EL2QEB5XFX3Q3E7L3EQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.463371160 (20h18m5.284322212s) [noise=true , address=104.36.82.8:4975 , piece_id=XHBIYRPC5V4PZ6BWMNIHDB7DMXSNQNQ3TMQGFWHS6BEYJHSMECGQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:18.671396561 (20h18m5.492347679s) [noise=true , address=104.36.82.5:4843 , piece_id=PDRES3VAGIUY5HCBBXEFVSV6JH6XBVPE4XBJX4MOEKOUYPLARMZA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.224833024 (20h18m6.045784082s) [noise=true , address=104.36.82.41:4776 , piece_id=3C4ECU73MOVDM2DHOIQVS7WH7NUQU5XDR5DRUVEZT4XS4HAIDU4A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:19.397216833 (20h18m6.218167886s) [noise=true , address=104.36.82.10:4109 , piece_id=L3L7TFVEXYJDVKLK64Y77MOE2UY2WM2IICOZCMETALNYTES7LT6Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.418753441 (20h18m8.239704499s) [noise=true , address=104.36.82.4:4836 , piece_id=G3C2QR3F4R3CBSVBGNCA4KDO4HNUPM42HCVK5PFTZ4IEBQAVEYMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:21.829676727 (20h18m8.65062777s) [noise=true , address=104.36.82.15:4278 , piece_id=OMJNBTM3WGXOF2GQQBFFP6A2WKXDYFDARY2TCRITB4HUBTKX34FA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:22.811871483 (20h18m9.632822546s) [noise=true , address=104.36.82.12:4154 , piece_id=R3YRXXXST2T2BULL4HT6Z27YGSWTHS4AQUZCHAWWBPQPRSKEBGPQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:27.783879469 (20h18m14.604830529s) [noise=true , address=104.36.82.52:4102 , piece_id=NDNBSEKVPUJQAS7MIR3MBASTHRVNVUICXQOGG4X7QIQFTIRV4TCA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.816954154 (20h18m16.637905205s) [noise=true , address=104.36.82.11:4134 , piece_id=HDB7VVM25FJDCQLQ6FBWXXL77YQQKCZMQMZSUBQ6HU44EWFXQHUA, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:29.957617841 (20h18m16.778568891s) [noise=true , address=104.36.82.47:4525 , piece_id=Z4KH46HGQGQH3CSRTIUIGXQ3WVYPQMKPJ2EVXH2EQ25GIODENSDQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:34.376100846 (20h18m21.197051907s) [noise=true , address=104.36.82.55:4213 , piece_id=UJMDNRMYM4OIP65Q43PPYI57AFJ7JDLJSIQ6SXJKWOHULMKDM66Q, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:03:38.373801355 (20h18m25.194752405s) [noise=true , address=104.36.82.16:4326 , piece_id=LSX5DM5EFFISTVCFQN7INNC4H24LLXE27XQWHVBZFJEEYRGZWXMQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460531656 (20h18m56.281482716s) [noise=true , address=104.36.82.20:4439 , piece_id=P2BWV2INBJ3VPGBV757T2VV6X7BHLCNWVCTR3A4DD7POIXEROZNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: <nil>
Jul 29 13:04:09.460569642 (20h18m56.281520704s) [seg_pos={0 0}, upload=19520]: Segment reached optimal threshold of 14 pieces.
Jul 29 13:04:09.461051937 (20h18m56.282002988s) [noise=true , address=104.36.82.54:4161 , piece_id=NK4PUGZS3ZJGJ7GWM3JUJ7B5CMTEF5CZV3IZHNTL57H72Q7TTQRQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pyhMcYjL5b9posZurgKXBnCHaMhaEjL3q3YWyc3aWkcYwbvTD): protocol: rpc: dial tcp 104.36.82.54:4161: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461121921 (20h18m56.282072968s) [noise=true , address=104.36.82.60:4357 , piece_id=X73P4527YXDKJW4MDAV73VAZ7FC6HWGLE5PNOBQG3XLAJ3DQTGWQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: rpc: dial tcp 104.36.82.60:4357: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461166528 (20h18m56.282117587s) [noise=true , address=104.36.82.54:4176 , piece_id=2SSH23T5N6ZMFPGOJLG52MKF57UP63EZE43W46RKQ3522CF3DP3A, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Yi5AibNiCNV8vUb9MKgooHCw8Nr79m9HqTrkrYybNZmatg9PD): protocol: rpc: dial tcp 104.36.82.54:4176: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461205682 (20h18m56.282156737s) [noise=true , address=104.36.82.46:4515 , piece_id=AFAJHFASWKS5X7B7KFXALTE3W5OD4RABMWNXOHQEUGOGNIFXNUNQ, seg_pos={0 0}, upload=19520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iDufTPd97E4DAupki6D6DxNZS8S1gKwynNBYynsauhbw5waUs): protocol: write tcp 159.223.143.39:53670->104.36.82.46:4515: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 29 13:04:09.461247841 (20h18m56.282198906s) [seg_pos={0 0}, upload=19520]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 29 13:04:09.461347916 (20h18m56.282298975s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 29 13:04:09.461354279 (20h18m56.282305337s) [upload=19520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 29 13:04:09.513873080 (20h18m56.334824138s) [upload=19520]: Done uploading segments...
Jul 29 13:04:09.513907949 (20h18m56.334859009s) [upload=19520]: Upload finished. err: <nil>
Duration: 707.301088ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
4.728272632s
FAIL (2025-07-29 13:22:08 UTC)
orbiter warning: uplink: encryption: context deadline exceeded
Duration: 4.728306935s
core
uplink
ap1
|