Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 150508 reports (Page 2688 of 3011)
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration: 
4.727671956s
FAIL (2025-07-15 00:59:44 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.727721141s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
319.329285ms
FAIL (2025-07-15 00:59:43 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 319.356945ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
240.364507ms
FAIL (2025-07-15 00:59:41 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 240.422372ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
3 out of 60 is failed (threshold=3) [...............X.................................XX.........]
duration: 
29.92684ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:59:41 UTC) 
Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout
Duration: 29.955415ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
65.263282ms
FAIL (2025-07-15 00:59:29 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 65.288414ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration: 
1.881450065s
FAIL (2025-07-15 00:59:23 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.881491258s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
253.291843ms
FAIL (2025-07-15 00:59:17 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 253.344428ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
3 out of 60 is failed (threshold=3) [................X.................................XX........]
duration: 
28.16163ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:59:11 UTC) 
Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout
Duration: 28.193816ms core satellite us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration: 
43.416567ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:59:06 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 43.462409ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration: 
1.791192542s
FAIL (2025-07-15 00:59:04 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.791222621s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
507.608496ms
FAIL (2025-07-15 00:59:01 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 507.737951ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
2 out of 60 is failed (threshold=3) [..............XX............................................]
duration: 
499.244547ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:58:55 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 499.277167ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [................XX..........................................]
duration: 
726.045935ms
target: 
https://ap1.storj.io/login
FAIL (2025-07-15 00:58:54 UTC) 
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 726.070024ms core satellite ap1
checkers.HTTP{"GET" "https://tardigrade.io/trusted-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.tardigrade_io_trusted_satellites)
antiblip: 
1 out of 15 is failed (threshold=6) [...........X...]
duration: 
57.628816ms
target: 
https://tardigrade.io/trusted-satellites
FAIL (2025-07-15 00:58:50 UTC) 
orbiter warning: Get "https://tardigrade.io/trusted-satellites": dial tcp: lookup tardigrade.io on 127.0.0.1:53: read udp 127.0.0.1:33062->127.0.0.1:53: i/o timeout
Duration: 57.664649ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................X........................................]
duration: 
1.930555519s
FAIL (2025-07-15 00:58:48 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.930576104s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
324.332475ms
FAIL (2025-07-15 00:58:47 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 324.364753ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.....................X..............................X.......]
duration: 
449.207347ms
FAIL (2025-07-15 00:58:44 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875     , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments...
Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil>
Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload
Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload
Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments...
Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false
Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment...
Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment.
Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663     , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729     , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909     , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078    , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006     , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258    , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222    , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518     , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839     , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875     , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155    , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801     , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590     , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083    , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189    , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697     , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment
Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments...
Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083    , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518     , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590     , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663     , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189    , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222    , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909     , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839     , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006     , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258    , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697     , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729     , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875     , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801     , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155    , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078    , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments...
Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil>
Duration: 449.236675ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration: 
110.474088ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:58:40 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 110.495469ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
3 out of 60 is failed (threshold=3) [.................X.................................XX.......]
duration: 
30.028574ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:58:39 UTC) 
Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout
Duration: 30.102525ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................................X........]
duration: 
253.897208ms
FAIL (2025-07-15 00:58:37 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 253.994669ms core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [...............X............................................]
duration: 
35.243819ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:58:34 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 35.273078ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://tardigrade.io/trusted-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.tardigrade_io_trusted_satellites)
antiblip: 
1 out of 15 is failed (threshold=6) [............X..]
duration: 
51.830606ms
target: 
https://tardigrade.io/trusted-satellites
FAIL (2025-07-15 00:58:31 UTC) 
orbiter warning: Get "https://tardigrade.io/trusted-satellites": dial tcp: lookup tardigrade.io on 127.0.0.1:53: read udp 127.0.0.1:33062->127.0.0.1:53: i/o timeout
Duration: 51.919667ms core website
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [........................X...................................]
duration: 
4.784220034s
FAIL (2025-07-15 00:58:30 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.784252072s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
2 out of 60 is failed (threshold=3) [...............XX...........................................]
duration: 
267.769614ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:58:29 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 267.788123ms edge gateway vhost bgp ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
58.15659ms
FAIL (2025-07-15 00:58:24 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 58.185421ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [...................X........................................]
duration: 
110.518593ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:58:19 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 110.547023ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [................X...........................................]
duration: 
43.280757ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:58:14 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 43.310151ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
530.862812ms
FAIL (2025-07-15 00:58:12 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 531.211938ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
387.456334ms
FAIL (2025-07-15 00:57:58 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 387.519905ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
2 out of 60 is failed (threshold=3) [................XX..........................................]
duration: 
264.280856ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:57:56 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 264.309585ms edge gateway vhost bgp ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
84.711205ms
FAIL (2025-07-15 00:57:53 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 84.800651ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration: 
103.527871ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:57:51 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 103.577121ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration: 
275.870365ms
FAIL (2025-07-15 00:57:50 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 275.895695ms core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration: 
34.239738ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:57:48 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 34.269182ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip: 
2 out of 60 is failed (threshold=3) [.................XX.........................................]
duration: 
704.347237ms
target: 
https://ap1.storj.io/login
FAIL (2025-07-15 00:57:48 UTC) 
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 704.483377ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration: 
4.915122019s
FAIL (2025-07-15 00:57:45 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.915288465s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration: 
1.803723661s
FAIL (2025-07-15 00:57:44 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.803746883s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [......................X..............................X......]
duration: 
477.784174ms
FAIL (2025-07-15 00:57:41 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875     , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments...
Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil>
Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload
Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload
Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments...
Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false
Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment...
Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment.
Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663     , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729     , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909     , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078    , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006     , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258    , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222    , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518     , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839     , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875     , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155    , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801     , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590     , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083    , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189    , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697     , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment
Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments...
Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083    , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518     , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590     , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663     , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189    , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222    , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909     , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839     , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006     , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258    , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697     , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729     , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875     , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801     , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155    , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078    , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments...
Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil>
Duration: 477.81676ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
2 out of 60 is failed (threshold=3) [.................XX.........................................]
duration: 
255.299344ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:57:41 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 255.328432ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip: 
3 out of 60 is failed (threshold=3) [..................X.................................XX......]
duration: 
30.690669ms
target: 
https://us1.storj.io/login
FAIL (2025-07-15 00:57:39 UTC) 
Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout
Duration: 30.717326ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration: 
257.763081ms
FAIL (2025-07-15 00:57:35 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 257.795991ms core uplink us1
checkers.HTTP{"GET" "https://tardigrade.io/trusted-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.tardigrade_io_trusted_satellites)
antiblip: 
1 out of 15 is failed (threshold=6) [.............X.]
duration: 
58.247452ms
target: 
https://tardigrade.io/trusted-satellites
FAIL (2025-07-15 00:57:35 UTC) 
orbiter warning: Get "https://tardigrade.io/trusted-satellites": dial tcp: lookup tardigrade.io on 127.0.0.1:53: read udp 127.0.0.1:33062->127.0.0.1:53: i/o timeout
Duration: 58.271866ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
496.76057ms
FAIL (2025-07-15 00:57:29 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 496.782634ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration: 
326.217619ms
FAIL (2025-07-15 00:57:26 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 326.244711ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration: 
48.993801ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:57:17 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 49.01882ms edge gateway vhost bgp us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration: 
58.947132ms
FAIL (2025-07-15 00:57:03 UTC) 
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 58.974704ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration: 
1.904659597s
FAIL (2025-07-15 00:56:59 UTC) 
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.904691627s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
2 out of 60 is failed (threshold=3) [..................XX........................................]
duration: 
256.488857ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:56:59 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 256.521406ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration: 
103.138048ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:56:56 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 103.166929ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.......................X..............................X.....]
duration: 
464.77017ms
FAIL (2025-07-15 00:56:51 UTC) 
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
 ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875     , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments...
Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil>
Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload
Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload
Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments...
Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false
Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment...
Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment.
Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663     , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729     , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909     , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078    , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006     , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258    , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222    , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518     , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839     , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875     , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155    , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801     , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590     , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083    , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189    , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697     , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment
Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments...
Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083    , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518     , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590     , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663     , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189    , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222    , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909     , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839     , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006     , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258    , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697     , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729     , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875     , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801     , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155    , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078    , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments...
Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil>
Duration: 464.798549ms core uplink us-select-1