Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 494.062499ms FAIL (2025-07-15 01:22:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 494.091972ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X..............XX..............................] duration: 504.106727ms FAIL (2025-07-15 01:22:27 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 504.13699ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..................X................X........................] duration: 68.840645ms FAIL (2025-07-15 01:22:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 68.917375ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 272.365552ms FAIL (2025-07-15 01:22:10 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 272.411601ms core uplink us1
checkers.HTTP{"GET" "https://storj.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.storj_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 10.006787913s target: https://storj.io/ FAIL (2025-07-15 01:22:04 UTC) orbiter warning: Get "https://storj.io/": dial tcp: lookup storj.io on 127.0.0.1:53: read udp 127.0.0.1:54555->127.0.0.1:53: i/o timeout Duration: 10.006818531s core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X..............XX.............................] duration: 525.320556ms FAIL (2025-07-15 01:22:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 525.36916ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 32.577791ms target: https://us1.storj.io/login FAIL (2025-07-15 01:21:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 32.660939ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 31.207592ms target: https://us1.storj.io/login FAIL (2025-07-15 01:21:36 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 31.23721ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X................X...........................] duration: 349.343378ms FAIL (2025-07-15 01:21:30 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 349.372405ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 647.204387ms FAIL (2025-07-15 01:21:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 647.236914ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 246.347455ms FAIL (2025-07-15 01:21:15 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 246.380349ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X................X..........................] duration: 281.638528ms FAIL (2025-07-15 01:21:13 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 281.690431ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 207.62773ms target: https://us1.storj.io/login FAIL (2025-07-15 01:21:07 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 207.659015ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X..............XX............................] duration: 569.771276ms FAIL (2025-07-15 01:21:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 569.798206ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [...................X................X.......................] duration: 83.001854ms FAIL (2025-07-15 01:21:02 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 83.044393ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 451.455679ms FAIL (2025-07-15 01:20:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 451.500843ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 30.970523ms target: https://us1.storj.io/login FAIL (2025-07-15 01:20:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 31.000919ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 442.23023ms FAIL (2025-07-15 01:20:43 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 442.2827ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X................X.........................] duration: 280.966795ms FAIL (2025-07-15 01:20:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 280.993624ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 176.113019ms target: https://us1.storj.io/login FAIL (2025-07-15 01:20:22 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 176.148136ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X..............XX...........................] duration: 475.387847ms FAIL (2025-07-15 01:20:17 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 475.416632ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X................X........................] duration: 299.153437ms FAIL (2025-07-15 01:20:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 299.177756ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [....................X................X......................] duration: 62.93828ms FAIL (2025-07-15 01:20:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 62.994789ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 577.933094ms FAIL (2025-07-15 01:20:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 577.971696ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X..............XX..........................] duration: 502.198447ms FAIL (2025-07-15 01:19:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 502.22664ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 272.850903ms FAIL (2025-07-15 01:19:34 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 272.884697ms core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 63.124117ms target: https://us1.storj.io/login FAIL (2025-07-15 01:19:25 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 63.152756ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 436.169973ms FAIL (2025-07-15 01:19:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 436.200072ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X..............XX.........................] duration: 508.792327ms FAIL (2025-07-15 01:19:19 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 508.821188ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X................X.......................] duration: 293.923963ms FAIL (2025-07-15 01:19:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 293.945642ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.....................X................X.....................] duration: 65.829814ms FAIL (2025-07-15 01:19:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 65.860063ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 31.310838ms target: https://us1.storj.io/login FAIL (2025-07-15 01:18:57 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 31.48387ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X................X......................] duration: 265.364709ms FAIL (2025-07-15 01:18:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 265.392405ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 451.245893ms FAIL (2025-07-15 01:18:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 451.279017ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 284.738563ms FAIL (2025-07-15 01:18:25 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 284.774203ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X..............XX........................] duration: 510.274416ms FAIL (2025-07-15 01:18:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 510.306951ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 415.512003ms FAIL (2025-07-15 01:18:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 415.553158ms core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.........................XX.................................] duration: 381.803374ms target: https://us1.storj.io/login FAIL (2025-07-15 01:18:12 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 381.833296ms core satellite us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [......................X................X....................] duration: 70.155229ms FAIL (2025-07-15 01:18:12 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 70.18655ms edge authservice http us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.818199013s FAIL (2025-07-15 01:18:08 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 4.818229423s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X..............XX.......................] duration: 506.317959ms FAIL (2025-07-15 01:17:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 506.340685ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X................X.....................] duration: 503.643878ms FAIL (2025-07-15 01:17:48 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 503.670372ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 453.041827ms FAIL (2025-07-15 01:17:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 453.071608ms core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.......................X................X...................] duration: 63.223638ms FAIL (2025-07-15 01:17:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 63.25318ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 280.679005ms FAIL (2025-07-15 01:17:21 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 280.730295ms core uplink us1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [........................X................X..................] duration: 65.354024ms FAIL (2025-07-15 01:17:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:58822->127.0.0.1:53: i/o timeout Duration: 65.380668ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X................X....................] duration: 534.598172ms FAIL (2025-07-15 01:17:13 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:42004->127.0.0.1:53: i/o timeout Duration: 534.684259ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 41.1391ms target: https://us1.storj.io/login FAIL (2025-07-15 01:17:05 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:39250->127.0.0.1:53: i/o timeout Duration: 41.162218ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 495.586958ms FAIL (2025-07-15 01:17:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285687709 (519h39m22.211982402s) [noise=true , address=104.36.82.6:4875 , piece_id=EI2GYFUMGM4RBVMZ4YX4XBHU2F4DGW7JU3WFO7ZJ3PB5TA5JEPAA, seg_pos={0 0}, upload=415855]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: expected piece hash; context canceled; EOF Jul 15 00:50:55.285704441 (519h39m22.211999129s) [seg_pos={0 0}, upload=415855]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 15 00:50:55.285782799 (519h39m22.212077495s) [upload=415855]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:50:55.285789426 (519h39m22.212084124s) [upload=415855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:50:55.339105588 (519h39m22.265400284s) [upload=415855]: Done uploading segments... Jul 15 00:50:55.339127659 (519h39m22.265422364s) [upload=415855]: Upload finished. err: <nil> Jul 15 00:52:03.633999496 (519h40m30.560294172s) [upload=415871]: Starting upload Jul 15 00:52:03.634082952 (519h40m30.560377645s) [upload=415871]: Done starting upload Jul 15 00:52:03.634209535 (519h40m30.560504222s) [upload=415871]: Uploading segments... Jul 15 00:52:03.634480377 (519h40m30.560775053s) [upload=415871]: Got next segment. Inline: false Jul 15 00:52:03.634530708 (519h40m30.560825395s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 15 00:52:03.634536382 (519h40m30.560831069s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 15 00:52:03.695685280 (519h40m30.621979973s) [seg_pos={0 0}, upload=415871]: Begin upload segment... Jul 15 00:52:03.695768486 (519h40m30.622063158s) [seg_pos={0 0}, upload=415871]: Done begin upload segment. Jul 15 00:52:03.695803916 (519h40m30.622098609s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696411043 (519h40m30.622705739s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.696879328 (519h40m30.623174024s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.697539086 (519h40m30.623833786s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698495186 (519h40m30.624789876s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.698964985 (519h40m30.625259674s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699380429 (519h40m30.625675118s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.699832706 (519h40m30.626127395s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701385016 (519h40m30.627679726s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.701879105 (519h40m30.628173794s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.702867315 (519h40m30.629162012s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.703883641 (519h40m30.63017834s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.704552977 (519h40m30.630847673s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705047441 (519h40m30.631342118s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705519581 (519h40m30.631814267s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.705848528 (519h40m30.6321432s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Uploading piece... Jul 15 00:52:03.827107120 (519h40m30.753401817s) [upload=415871]: Next returned nil segment Jul 15 00:52:03.827125125 (519h40m30.753419825s) [upload=415871]: Waiting for error group managing segments... Jul 15 00:52:03.831917682 (519h40m30.758212372s) [noise=true , address=45.91.116.10:4083 , piece_id=GBI3BQEAT7HCN3DP775SJ3FERFVDOXOTVCW6RZWKCP7P6T5K7DWQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.832572362 (519h40m30.758867042s) [noise=true , address=77.90.31.10:4518 , piece_id=BBO7ZS4WLRV2F3DSPQEG3VDH2BCPL6NHSVHVMIF7JDYZOU2PGPFQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833108591 (519h40m30.759403279s) [noise=true , address=77.90.31.12:4590 , piece_id=W7ZVFJDIJNFOJ2ONAIL5FB6QIDW75FV23MTQYIDISNTI4HMWP72Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.833610214 (519h40m30.7599049s) [noise=true , address=77.90.31.14:4663 , piece_id=FTJPZQIFAM7DTUAQPLMWWQKA6ECPZCHYVRM7CVQRYYZWGOZKPE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.834676903 (519h40m30.760971596s) [noise=true , address=45.91.116.14:4189 , piece_id=Y52DGD267UU5OQKDFDZYYUL3DWIMFDI6TX533SOWBCZCLRMMTE2Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.839879741 (519h40m30.766174428s) [noise=true , address=104.36.82.14:4222 , piece_id=JF7XOB4JLIJYZS2KDBVBATWQWRD4OS43IVFTSPJYVCCLAF2OWOYA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.840357933 (519h40m30.76665261s) [noise=true , address=104.36.82.7:4909 , piece_id=4LWX2WM4TEUJK7NLMIEN45CODLCYMX5QJ75DIIODXYKH5JEWUFJA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841075253 (519h40m30.767369934s) [noise=true , address=104.36.82.5:4839 , piece_id=6SLBVGQTJFRJP7QA2CVG2ARGYYFWLRBOCBN33O5WN4NUTRFT6DUA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.841610950 (519h40m30.767905627s) [noise=true , address=104.36.82.9:4006 , piece_id=BFYMJD5WM7LZRLRDOU42ICLG5GXJIKTHSCFTJZIDV5BXBXTUPWYQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842107860 (519h40m30.768402541s) [noise=true , address=104.36.82.15:4258 , piece_id=LHV6F4ZT6OFPKGOVGBSE3KHNND2SF3WWM4XRRE7QGNLG22ZQ5KGQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.842764021 (519h40m30.769058699s) [noise=true , address=77.90.31.15:4697 , piece_id=E3ZD7PJOQTOETE66TKCAMXM33JDTJUVTHUGGZ4EAN25DFFNCAUTA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843339192 (519h40m30.769633866s) [noise=true , address=104.36.82.2:4729 , piece_id=AJMUHTXD4T27L6QOQT2MESVEJ2P5S7AITD77NA5D5KHSWLUSLO6Q, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843944968 (519h40m30.77023966s) [noise=true , address=104.36.82.6:4875 , piece_id=UXCSD7HDZCRJ5WW6235ZQAT2FICARKHZWI7A2YE3JVNWA5W7GSOQ, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.843958762 (519h40m30.770253441s) [seg_pos={0 0}, upload=415871]: Segment reached optimal threshold of 13 pieces. Jul 15 00:52:03.844132370 (519h40m30.770427052s) [noise=true , address=104.36.82.4:4801 , piece_id=W4ZHXNHCSFTQ4PNBUE44FFD6BML36MXLADIK7W4EMUNWIJW2FZ3A, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844340698 (519h40m30.770635385s) [noise=true , address=45.91.116.13:4155 , piece_id=7HXRG74ZSSX42CIXL6SVROLXE22DFC4BLPIXAQOOGOIGD6CPRYPA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf): protocol: expected piece hash; context canceled; EOF Jul 15 00:52:03.844694597 (519h40m30.770989276s) [noise=true , address=104.36.82.10:4078 , piece_id=OZJCT2NLKSVSJLZNTUZKP4FHNJPTZ3WAMKFLWH3YZEOLLDRJ3IOA, seg_pos={0 0}, upload=415871]: Done uploading piece. err: <nil> Jul 15 00:52:03.844732096 (519h40m30.77102683s) [seg_pos={0 0}, upload=415871]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 15 00:52:03.844815170 (519h40m30.771109852s) [upload=415871]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 15 00:52:03.844820406 (519h40m30.771115095s) [upload=415871]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 15 00:52:03.899279901 (519h40m30.825574576s) [upload=415871]: Done uploading segments... Jul 15 00:52:03.899298008 (519h40m30.825592687s) [upload=415871]: Upload finished. err: <nil> Duration: 495.704837ms core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 4.694391444s FAIL (2025-07-15 01:16:56 UTC) orbiter warning: uplink: bucket: metaclient: context deadline exceeded Duration: 4.694424067s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://storj.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.storj_io)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)