Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.822385112s
FAIL (2025-07-15 00:53:40 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.822411419s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.................................XX.] duration:
29.420656ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:53:38 UTC)
Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout
Duration: 29.44559ms
core
satellite
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.79653703s
FAIL (2025-07-15 00:53:36 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.796564848s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
278.704091ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:53:34 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 278.730418ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..............................X.] duration:
486.893626ms
FAIL (2025-07-15 00:53:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments...
Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil>
Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload
Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload
Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments...
Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false
Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment...
Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment.
Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment
Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments...
Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments...
Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil>
Duration: 486.920653ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
15.701461207s
FAIL (2025-07-15 00:53:29 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 15.701490435s
core
uplink
us1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
222.747249ms
FAIL (2025-07-15 00:53:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 222.781496ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
28.303724ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:53:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 28.339489ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001233202s
FAIL (2025-07-15 00:53:18 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001254416s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..............................X] duration:
30.001295801s
FAIL (2025-07-15 00:53:14 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF
Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments...
Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil>
Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload
Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload
Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments...
Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false
Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment...
Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment.
Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece...
Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment
Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments...
Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF
Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil>
Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments...
Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil>
Duration: 30.001315177s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
261.094554ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:53:14 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 261.121159ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
104.654012ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:53:09 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 104.686333ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [........................X.................................XX] duration:
4.31367378s target:
https://us1.storj.io/login
FAIL (2025-07-15 00:53:02 UTC)
Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout
Duration: 4.313702725s
core
satellite
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
264.958178ms
FAIL (2025-07-15 00:53:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 264.985619ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
607.058084ms
FAIL (2025-07-15 00:52:58 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 607.085246ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.................................X] duration:
10.001986034s target:
https://us1.storj.io/login
FAIL (2025-07-15 00:52:52 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:50553->127.0.0.1:53: i/o timeout
Duration: 10.002012356s
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
40.710793ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:52:49 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 40.740096ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
710.920521ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:52:42 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 710.948812ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
242.023459ms
FAIL (2025-07-15 00:52:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 242.051724ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.78688884s
FAIL (2025-07-15 00:52:28 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.786916074s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
57.032948ms
FAIL (2025-07-15 00:52:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 57.079355ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
257.031611ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:52:26 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 257.059543ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
719.937497ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:52:23 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 719.958885ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
115.668498ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:52:16 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 115.701176ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.763702281s
FAIL (2025-07-15 00:52:13 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.76373694s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
485.234186ms
FAIL (2025-07-15 00:52:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
piece_id=4XIRWFKYZRXVBIDDGKFCV6PZILBBGHWVDQCOV7LDQE6M4KVCENZA, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.990999751 (519h14m31.917294441s) [noise=true , address=104.36.82.10:4077 , piece_id=H3FXODESAOUQMFKTPDUTKVVCN26E4BJJ6RK3L4FK4BDKDPK2IDPQ, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.994234922 (519h14m31.920529612s) [seg_pos={0 0}, upload=415540]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 15 00:26:04.994412732 (519h14m31.92070742s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:04.994419991 (519h14m31.920714669s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:05.052077449 (519h14m31.978372155s) [upload=415540]: Done uploading segments...
Jul 15 00:26:05.052103421 (519h14m31.978398125s) [upload=415540]: Upload finished. err: <nil>
Jul 15 00:26:38.958141934 (519h15m5.884436612s) [upload=415547]: Starting upload
Jul 15 00:26:38.958201231 (519h15m5.884495926s) [upload=415547]: Done starting upload
Jul 15 00:26:38.958314419 (519h15m5.884609106s) [upload=415547]: Uploading segments...
Jul 15 00:26:38.958527717 (519h15m5.884822403s) [upload=415547]: Got next segment. Inline: false
Jul 15 00:26:38.958568846 (519h15m5.884863531s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:26:38.958574194 (519h15m5.884868881s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:26:38.983569545 (519h15m5.909864232s) [seg_pos={0 0}, upload=415547]: Begin upload segment...
Jul 15 00:26:38.983616193 (519h15m5.909910881s) [seg_pos={0 0}, upload=415547]: Done begin upload segment.
Jul 15 00:26:38.983654916 (519h15m5.909949609s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.984140706 (519h15m5.910435399s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985394041 (519h15m5.911688736s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985448268 (519h15m5.911742957s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.986646166 (519h15m5.912940863s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.987790595 (519h15m5.914085293s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.990052347 (519h15m5.916347044s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.992712744 (519h15m5.919007436s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993046170 (519h15m5.919340862s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993293420 (519h15m5.919588107s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993559008 (519h15m5.919853696s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998405965 (519h15m5.92470064s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998757342 (519h15m5.925052034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.008233673 (519h15m5.934528364s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.014122054 (519h15m5.940416728s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.018124788 (519h15m5.944419475s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.091207534 (519h15m6.01750222s) [upload=415547]: Next returned nil segment
Jul 15 00:26:39.091223696 (519h15m6.017518383s) [upload=415547]: Waiting for error group managing segments...
Jul 15 00:26:39.092995382 (519h15m6.019290055s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094440372 (519h15m6.02073505s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094889705 (519h15m6.021184385s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095463738 (519h15m6.021758418s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095885481 (519h15m6.022180168s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.096458464 (519h15m6.022753154s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097271208 (519h15m6.023565885s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097390539 (519h15m6.023685219s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099260264 (519h15m6.025554945s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099412522 (519h15m6.025707203s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099786150 (519h15m6.026080838s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.102454228 (519h15m6.028748916s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104208070 (519h15m6.030502749s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104226636 (519h15m6.030521322s) [seg_pos={0 0}, upload=415547]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:26:39.104335264 (519h15m6.030629951s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104553329 (519h15m6.030848017s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104574593 (519h15m6.030869266s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: rpc: dial tcp 104.36.82.11:4114: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 15 00:26:39.104611772 (519h15m6.030906482s) [seg_pos={0 0}, upload=415547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:26:39.104702706 (519h15m6.030997398s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:39.104708334 (519h15m6.031003021s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:39.153946432 (519h15m6.080241109s) [upload=415547]: Done uploading segments...
Jul 15 00:26:39.153985991 (519h15m6.080280681s) [upload=415547]: Upload finished. err: <nil>
Duration: 485.268598ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
535.531968ms
FAIL (2025-07-15 00:51:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 535.555433ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
31.18748ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:51:54 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 31.214639ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
100.394329ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:51:52 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 100.418334ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
725.122825ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:51:51 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 725.16366ms
core
satellite
ap1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
69.544795ms
FAIL (2025-07-15 00:51:44 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 69.56264ms
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
274.039151ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:51:42 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 274.060581ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.642367556s
FAIL (2025-07-15 00:51:39 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.642401383s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
31.979025ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:51:36 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:33324->127.0.0.1:53: i/o timeout
Duration: 32.005585ms
core
satellite
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.691585704s
FAIL (2025-07-15 00:51:26 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.691644965s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
703.177868ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:51:24 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 703.202432ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
246.832822ms
FAIL (2025-07-15 00:51:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 246.854719ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
271.722484ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:51:21 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 271.747331ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
528.514521ms
FAIL (2025-07-15 00:51:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 528.55545ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.825291832s
FAIL (2025-07-15 00:51:10 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.825323133s
core
uplink
us1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
32.157969ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:51:07 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:33324->127.0.0.1:53: i/o timeout
Duration: 32.186446ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
507.783908ms
FAIL (2025-07-15 00:50:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
piece_id=4XIRWFKYZRXVBIDDGKFCV6PZILBBGHWVDQCOV7LDQE6M4KVCENZA, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.990999751 (519h14m31.917294441s) [noise=true , address=104.36.82.10:4077 , piece_id=H3FXODESAOUQMFKTPDUTKVVCN26E4BJJ6RK3L4FK4BDKDPK2IDPQ, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.994234922 (519h14m31.920529612s) [seg_pos={0 0}, upload=415540]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 15 00:26:04.994412732 (519h14m31.92070742s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:04.994419991 (519h14m31.920714669s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:05.052077449 (519h14m31.978372155s) [upload=415540]: Done uploading segments...
Jul 15 00:26:05.052103421 (519h14m31.978398125s) [upload=415540]: Upload finished. err: <nil>
Jul 15 00:26:38.958141934 (519h15m5.884436612s) [upload=415547]: Starting upload
Jul 15 00:26:38.958201231 (519h15m5.884495926s) [upload=415547]: Done starting upload
Jul 15 00:26:38.958314419 (519h15m5.884609106s) [upload=415547]: Uploading segments...
Jul 15 00:26:38.958527717 (519h15m5.884822403s) [upload=415547]: Got next segment. Inline: false
Jul 15 00:26:38.958568846 (519h15m5.884863531s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:26:38.958574194 (519h15m5.884868881s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:26:38.983569545 (519h15m5.909864232s) [seg_pos={0 0}, upload=415547]: Begin upload segment...
Jul 15 00:26:38.983616193 (519h15m5.909910881s) [seg_pos={0 0}, upload=415547]: Done begin upload segment.
Jul 15 00:26:38.983654916 (519h15m5.909949609s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.984140706 (519h15m5.910435399s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985394041 (519h15m5.911688736s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985448268 (519h15m5.911742957s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.986646166 (519h15m5.912940863s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.987790595 (519h15m5.914085293s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.990052347 (519h15m5.916347044s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.992712744 (519h15m5.919007436s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993046170 (519h15m5.919340862s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993293420 (519h15m5.919588107s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993559008 (519h15m5.919853696s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998405965 (519h15m5.92470064s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998757342 (519h15m5.925052034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.008233673 (519h15m5.934528364s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.014122054 (519h15m5.940416728s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.018124788 (519h15m5.944419475s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.091207534 (519h15m6.01750222s) [upload=415547]: Next returned nil segment
Jul 15 00:26:39.091223696 (519h15m6.017518383s) [upload=415547]: Waiting for error group managing segments...
Jul 15 00:26:39.092995382 (519h15m6.019290055s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094440372 (519h15m6.02073505s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094889705 (519h15m6.021184385s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095463738 (519h15m6.021758418s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095885481 (519h15m6.022180168s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.096458464 (519h15m6.022753154s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097271208 (519h15m6.023565885s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097390539 (519h15m6.023685219s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099260264 (519h15m6.025554945s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099412522 (519h15m6.025707203s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099786150 (519h15m6.026080838s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.102454228 (519h15m6.028748916s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104208070 (519h15m6.030502749s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104226636 (519h15m6.030521322s) [seg_pos={0 0}, upload=415547]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:26:39.104335264 (519h15m6.030629951s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104553329 (519h15m6.030848017s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104574593 (519h15m6.030869266s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: rpc: dial tcp 104.36.82.11:4114: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 15 00:26:39.104611772 (519h15m6.030906482s) [seg_pos={0 0}, upload=415547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:26:39.104702706 (519h15m6.030997398s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:39.104708334 (519h15m6.031003021s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:39.153946432 (519h15m6.080241109s) [upload=415547]: Done uploading segments...
Jul 15 00:26:39.153985991 (519h15m6.080280681s) [upload=415547]: Upload finished. err: <nil>
Duration: 507.821041ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
106.602206ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:50:51 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 106.628802ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
706.531076ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:50:48 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 706.552056ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
266.289031ms
FAIL (2025-07-15 00:50:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 266.313089ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
30.16059ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:50:44 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:33324->127.0.0.1:53: i/o timeout
Duration: 30.188021ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
46.884995ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:50:43 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 46.907416ms
edge
gateway
vhost
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
76.880501ms
FAIL (2025-07-15 00:50:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 76.911622ms
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.903619571s
FAIL (2025-07-15 00:50:41 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.903646468s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
460.101506ms
FAIL (2025-07-15 00:50:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
piece_id=4XIRWFKYZRXVBIDDGKFCV6PZILBBGHWVDQCOV7LDQE6M4KVCENZA, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.990999751 (519h14m31.917294441s) [noise=true , address=104.36.82.10:4077 , piece_id=H3FXODESAOUQMFKTPDUTKVVCN26E4BJJ6RK3L4FK4BDKDPK2IDPQ, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.994234922 (519h14m31.920529612s) [seg_pos={0 0}, upload=415540]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 15 00:26:04.994412732 (519h14m31.92070742s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:04.994419991 (519h14m31.920714669s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:05.052077449 (519h14m31.978372155s) [upload=415540]: Done uploading segments...
Jul 15 00:26:05.052103421 (519h14m31.978398125s) [upload=415540]: Upload finished. err: <nil>
Jul 15 00:26:38.958141934 (519h15m5.884436612s) [upload=415547]: Starting upload
Jul 15 00:26:38.958201231 (519h15m5.884495926s) [upload=415547]: Done starting upload
Jul 15 00:26:38.958314419 (519h15m5.884609106s) [upload=415547]: Uploading segments...
Jul 15 00:26:38.958527717 (519h15m5.884822403s) [upload=415547]: Got next segment. Inline: false
Jul 15 00:26:38.958568846 (519h15m5.884863531s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:26:38.958574194 (519h15m5.884868881s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:26:38.983569545 (519h15m5.909864232s) [seg_pos={0 0}, upload=415547]: Begin upload segment...
Jul 15 00:26:38.983616193 (519h15m5.909910881s) [seg_pos={0 0}, upload=415547]: Done begin upload segment.
Jul 15 00:26:38.983654916 (519h15m5.909949609s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.984140706 (519h15m5.910435399s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985394041 (519h15m5.911688736s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985448268 (519h15m5.911742957s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.986646166 (519h15m5.912940863s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.987790595 (519h15m5.914085293s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.990052347 (519h15m5.916347044s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.992712744 (519h15m5.919007436s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993046170 (519h15m5.919340862s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993293420 (519h15m5.919588107s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993559008 (519h15m5.919853696s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998405965 (519h15m5.92470064s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998757342 (519h15m5.925052034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.008233673 (519h15m5.934528364s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.014122054 (519h15m5.940416728s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.018124788 (519h15m5.944419475s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.091207534 (519h15m6.01750222s) [upload=415547]: Next returned nil segment
Jul 15 00:26:39.091223696 (519h15m6.017518383s) [upload=415547]: Waiting for error group managing segments...
Jul 15 00:26:39.092995382 (519h15m6.019290055s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094440372 (519h15m6.02073505s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094889705 (519h15m6.021184385s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095463738 (519h15m6.021758418s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095885481 (519h15m6.022180168s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.096458464 (519h15m6.022753154s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097271208 (519h15m6.023565885s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097390539 (519h15m6.023685219s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099260264 (519h15m6.025554945s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099412522 (519h15m6.025707203s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099786150 (519h15m6.026080838s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.102454228 (519h15m6.028748916s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104208070 (519h15m6.030502749s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104226636 (519h15m6.030521322s) [seg_pos={0 0}, upload=415547]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:26:39.104335264 (519h15m6.030629951s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104553329 (519h15m6.030848017s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104574593 (519h15m6.030869266s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: rpc: dial tcp 104.36.82.11:4114: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 15 00:26:39.104611772 (519h15m6.030906482s) [seg_pos={0 0}, upload=415547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:26:39.104702706 (519h15m6.030997398s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:39.104708334 (519h15m6.031003021s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:39.153946432 (519h15m6.080241109s) [upload=415547]: Done uploading segments...
Jul 15 00:26:39.153985991 (519h15m6.080280681s) [upload=415547]: Upload finished. err: <nil>
Duration: 460.136024ms
core
uplink
us-select-1
|