Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 150448 reports (Page 2725 of 3009)
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
368.222123ms
FAIL (2025-07-14 23:20:23 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:36013->127.0.0.1:53: i/o timeout
Duration: 368.248809ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..................X.......................................X.]
duration:
905.352257ms
FAIL (2025-07-14 23:20:19 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 905.40666ms core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....................................XX.....................]
duration:
397.758931ms
FAIL (2025-07-14 23:20:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 397.970255ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
4.722345883s
FAIL (2025-07-14 23:20:16 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.722379747s core uplink ap1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)
antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................]
duration:
264.400908ms
target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 23:20:09 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": dial tcp: lookup www.storj-ipfs.com on 127.0.0.1:53: read udp 127.0.0.1:54967->127.0.0.1:53: i/o timeout
Duration: 264.423467ms edge ipfs us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
2.055912683s
FAIL (2025-07-14 23:20:08 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.055957574s core uplink ap1
checkers.HTTP{"GET" "https://storj.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [....XX.........]
duration:
71.634662ms
target:
https://storj.io/
FAIL (2025-07-14 23:20:07 UTC)
orbiter warning: Get "https://storj.io/": dial tcp: lookup storj.io on 127.0.0.1:53: read udp 127.0.0.1:55551->127.0.0.1:53: i/o timeout
Duration: 71.725002ms core website
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
3 out of 60 is failed (threshold=3) [....X...................X......................X............]
duration:
281.78346ms
target:
https://eu1.storj.io/login
FAIL (2025-07-14 23:20:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:38618->127.0.0.1:53: i/o timeout
Duration: 281.817367ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [...X.................X........................X............X]
duration:
30.144579943s
FAIL (2025-07-14 23:20:05 UTC)
orbiter warning: uplink: encryption: failed to upload enough pieces (needed at least 49 but got 0)
Duration: 30.144609349s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................]
duration:
1.979498275s
FAIL (2025-07-14 23:20:00 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.979557096s core uplink us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
3 out of 60 is failed (threshold=3) [..X...XX....................................................]
duration:
21.764408ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-07-14 23:19:56 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59356->127.0.0.1:53: i/o timeout
Duration: 21.849598ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [X..................X.......................................X]
duration:
30.001308812s
FAIL (2025-07-14 23:19:55 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001327512s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................]
duration:
719.214338ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 23:19:53 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:45980->127.0.0.1:53: i/o timeout
Duration: 719.238917ms core satellite ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip:
4 out of 60 is failed (threshold=6) [.X..X........X.....................................X........]
duration:
279.102672ms
target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-07-14 23:19:50 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:44806->127.0.0.1:53: i/o timeout
Duration: 279.132915ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
533.915141ms
FAIL (2025-07-14 23:19:46 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: rpc: tcp connector failed: rpc: context deadline exceeded
======LOGS======
RequestItem_ObjectBegin
Jul 14 22:33:20.920268234 (517h21m47.84656293s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:33:20.956049835 (517h21m47.882344525s) [seg_pos={0 0}, upload=414055]: Begin upload segment...
Jul 14 22:33:20.956138063 (517h21m47.882432739s) [seg_pos={0 0}, upload=414055]: Done begin upload segment.
Jul 14 22:33:20.956148696 (517h21m47.88244339s) [noise=true , address=104.36.82.19:4432    , piece_id=ZNUQB26NCFHHETSPPLIX52BSR23AI2VO3J2BJA5O4FPUDRD6ILEA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.956179183 (517h21m47.882473875s) [noise=true , address=45.91.95.4:4001      , piece_id=C4KRMZGJX4PWVYSTRKXHCRK34AABH2ZLHVXXRKADJIOFOXX45LTA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.956739778 (517h21m47.883034473s) [noise=true , address=104.36.82.17:4334    , piece_id=6QFH4V2XP5HENEXYSPBLCGWESKAO2M7S243GVWQCSGYYANMDC5BQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957112661 (517h21m47.883407356s) [noise=true , address=45.91.116.14:4215    , piece_id=JB6J36RX7ZLVP4SBF3ZOJSXEZWILQXZOFUQON5WIWMRIAFDZYARA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957321762 (517h21m47.883616454s) [noise=true , address=77.90.31.19:4873     , piece_id=ALRBAJG2MS2FX2JQQORO5ZLLXGFQGMBIXLKRTQB3OKIICVAAQTKA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957534791 (517h21m47.883829483s) [noise=true , address=104.36.82.51:4074    , piece_id=HOC7FQM2ROFQMQOOQMXPD5HVLON2C6U2UVSS5HMLGRIWJIIO3MUQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957685297 (517h21m47.883979986s) [noise=true , address=45.91.116.10:4098    , piece_id=QAD3V2YB62ZWM7NR5YTZD5YBHIZONG64A27OM6C7WS6R6XE5IAKA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957863790 (517h21m47.884158483s) [noise=true , address=77.90.31.18:4810     , piece_id=L2G6QQTX3FVYCW7Z7FMLM6SAA7XZI64BRADRPCOUBLBRVL223KWQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958078206 (517h21m47.884372898s) [noise=true , address=77.90.31.11:4556     , piece_id=4WXTBJSV6F4WCYX3ETHYA7LKJEHEAFNNOD7E5X6GY65ZYUYEAC3A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958206699 (517h21m47.884501391s) [noise=true , address=45.91.116.6:4005     , piece_id=KZTESMI5CMWF5U7S6PXTUK5Z4HSVSXXA6CJ2VAVL5SLK2IVJG3DQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958449262 (517h21m47.884743949s) [noise=true , address=104.36.82.10:4101    , piece_id=6I325W4T6GYA7B6TXAEA33PGTNXQSWH5AB6MRRWPJM6O66LXTDAA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958598885 (517h21m47.884893577s) [noise=true , address=45.91.95.3:4028      , piece_id=WPAZ53X2MORZF3ZAL42BEZW2HQ2FC7YEBX7YGGFNLOBALDZB7JUQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958933707 (517h21m47.885228398s) [noise=true , address=77.90.31.15:4704     , piece_id=K7MIP54PNDQCEH6FKFEHFDYAYQ2ZWOHHARJ26JJYLD6YKJCRX64A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.959332655 (517h21m47.885627352s) [noise=true , address=77.90.31.12:4604     , piece_id=ZCE56GJ3B52UXNUIYQ6CFVR2CGCXDKZYXGY5CWY5235HAQHXRX6A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.959715836 (517h21m47.886010533s) [noise=true , address=45.91.116.10:4111    , piece_id=LCZSVS34DIVD4LVRF73L6ATATHWMR4DVJQ4GN3HADJSZTPLCFBTA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960115490 (517h21m47.886410182s) [noise=true , address=45.91.95.2:4005      , piece_id=XTY4LNMWW23XE7HEZ6GB2WOS37K3ZAOMY2EVCHIQLDB6IQDMWZ6A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960349946 (517h21m47.886644642s) [noise=true , address=77.90.31.14:4694     , piece_id=GXYYM54EJCQQHN7UNLTOP52UVHPQ2E7I36ETL64JMQWH6FT5KEGA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960857778 (517h21m47.88715247s) [noise=true , address=104.36.82.34:4562    , piece_id=HZ7BIXYA7TOMLS3ANW4SSS5WTPOYTRF6JOKO26KJR6TMBSJJPA4Q, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:21.054689329 (517h21m47.980984015s) [upload=414055]: Next returned nil segment
Jul 14 22:33:21.054703519 (517h21m47.980998192s) [upload=414055]: Waiting for error group managing segments...
Jul 14 22:33:21.067731227 (517h21m47.994025919s) [noise=true , address=104.36.82.34:4562    , piece_id=HZ7BIXYA7TOMLS3ANW4SSS5WTPOYTRF6JOKO26KJR6TMBSJJPA4Q, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.068562910 (517h21m47.994857586s) [noise=true , address=77.90.31.18:4810     , piece_id=L2G6QQTX3FVYCW7Z7FMLM6SAA7XZI64BRADRPCOUBLBRVL223KWQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.070198720 (517h21m47.996493396s) [noise=true , address=45.91.116.10:4111    , piece_id=LCZSVS34DIVD4LVRF73L6ATATHWMR4DVJQ4GN3HADJSZTPLCFBTA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.071365233 (517h21m47.997659906s) [noise=true , address=45.91.116.14:4215    , piece_id=JB6J36RX7ZLVP4SBF3ZOJSXEZWILQXZOFUQON5WIWMRIAFDZYARA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.071792066 (517h21m47.998086738s) [noise=true , address=45.91.116.6:4005     , piece_id=KZTESMI5CMWF5U7S6PXTUK5Z4HSVSXXA6CJ2VAVL5SLK2IVJG3DQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.074850939 (517h21m48.001145615s) [noise=true , address=77.90.31.11:4556     , piece_id=4WXTBJSV6F4WCYX3ETHYA7LKJEHEAFNNOD7E5X6GY65ZYUYEAC3A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.075297712 (517h21m48.001592384s) [noise=true , address=45.91.116.10:4098    , piece_id=QAD3V2YB62ZWM7NR5YTZD5YBHIZONG64A27OM6C7WS6R6XE5IAKA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.076301394 (517h21m48.002596084s) [noise=true , address=104.36.82.17:4334    , piece_id=6QFH4V2XP5HENEXYSPBLCGWESKAO2M7S243GVWQCSGYYANMDC5BQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.078308059 (517h21m48.00460275s) [noise=true , address=104.36.82.19:4432    , piece_id=ZNUQB26NCFHHETSPPLIX52BSR23AI2VO3J2BJA5O4FPUDRD6ILEA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.079380196 (517h21m48.005674875s) [noise=true , address=77.90.31.14:4694     , piece_id=GXYYM54EJCQQHN7UNLTOP52UVHPQ2E7I36ETL64JMQWH6FT5KEGA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.086892708 (517h21m48.013187388s) [noise=true , address=104.36.82.10:4101    , piece_id=6I325W4T6GYA7B6TXAEA33PGTNXQSWH5AB6MRRWPJM6O66LXTDAA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.096904024 (517h21m48.023198705s) [noise=true , address=77.90.31.19:4873     , piece_id=ALRBAJG2MS2FX2JQQORO5ZLLXGFQGMBIXLKRTQB3OKIICVAAQTKA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.097936100 (517h21m48.024230776s) [noise=true , address=77.90.31.12:4604     , piece_id=ZCE56GJ3B52UXNUIYQ6CFVR2CGCXDKZYXGY5CWY5235HAQHXRX6A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.107109151 (517h21m48.03340383s) [noise=true , address=77.90.31.15:4704     , piece_id=K7MIP54PNDQCEH6FKFEHFDYAYQ2ZWOHHARJ26JJYLD6YKJCRX64A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.107140287 (517h21m48.033434963s) [seg_pos={0 0}, upload=414055]: Segment reached optimal threshold of 14 pieces.
Jul 14 22:33:21.107798713 (517h21m48.034093407s) [noise=true , address=45.91.95.2:4005      , piece_id=XTY4LNMWW23XE7HEZ6GB2WOS37K3ZAOMY2EVCHIQLDB6IQDMWZ6A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bxFpBmz99gV4rL6bMtnHuthK2Xg4EusbfMAWF37RTRtPkqhQS): protocol: context canceled
Jul 14 22:33:21.107904677 (517h21m48.034199363s) [noise=true , address=104.36.82.51:4074    , piece_id=HOC7FQM2ROFQMQOOQMXPD5HVLON2C6U2UVSS5HMLGRIWJIIO3MUQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DBQpuE1EC1ENCy67We5QhMT6zsa2AbeMDSv8hmQLjokGRvoxc): protocol: write tcp 159.223.143.39:44794->104.36.82.51:4074: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 14 22:33:21.107928716 (517h21m48.034223405s) [noise=true , address=45.91.95.3:4028      , piece_id=WPAZ53X2MORZF3ZAL42BEZW2HQ2FC7YEBX7YGGFNLOBALDZB7JUQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Cn2vydXYjCSFYkLuBck57avzeCstHowf3cDQwtYn2RV2Wskh2): protocol: write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection; write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection
Jul 14 22:33:21.108008084 (517h21m48.034302763s) [noise=true , address=45.91.95.4:4001      , piece_id=C4KRMZGJX4PWVYSTRKXHCRK34AABH2ZLHVXXRKADJIOFOXX45LTA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PdimTdB4ysD3SQ8hKMAGAXkzzC71irLv6rW9FArf5qmrvZ5MY): protocol: read tcp 159.223.143.39:55404->45.91.95.4:4001: use of closed network connection; context canceled
Jul 14 22:33:21.108022527 (517h21m48.034317213s) [seg_pos={0 0}, upload=414055]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 14 22:33:21.108148869 (517h21m48.034443556s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:33:21.108154867 (517h21m48.034449552s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:33:21.175128505 (517h21m48.101423192s) [upload=414055]: Done uploading segments...
Jul 14 22:33:21.175148328 (517h21m48.101443004s) [upload=414055]: Upload finished. err: <nil>
Duration: 533.942015ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
373.685367ms
target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-14 23:19:39 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": dial tcp: lookup www.storj-ipfs.com on 127.0.0.1:53: read udp 127.0.0.1:40713->127.0.0.1:53: i/o timeout
Duration: 373.721561ms edge ipfs us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
38.472882ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:19:39 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44115->127.0.0.1:53: i/o timeout
Duration: 38.496477ms core satellite us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
3 out of 60 is failed (threshold=6) [..........XX......................................X.........]
duration:
30.593901ms
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
FAIL (2025-07-14 23:19:37 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:60313->127.0.0.1:53: i/o timeout
Duration: 30.724208ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....................................XX......................]
duration:
539.222531ms
FAIL (2025-07-14 23:19:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 539.916806ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
31.150286ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-14 23:19:34 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:40390->127.0.0.1:53: i/o timeout
Duration: 31.192472ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
3 out of 60 is failed (threshold=3) [...X...XX...................................................]
duration:
18.99136ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-07-14 23:19:33 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59356->127.0.0.1:53: i/o timeout
Duration: 19.035931ms edge linksharing us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
3 out of 60 is failed (threshold=6) [.X.X.............................................X..........]
duration:
102.412963ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-14 23:19:33 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:60313->127.0.0.1:53: i/o timeout
Duration: 102.463431ms edge linksharing bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
414.137364ms
FAIL (2025-07-14 23:19:27 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:36013->127.0.0.1:53: i/o timeout
Duration: 414.192584ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://storj.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [.....XX........]
duration:
47.455918ms
target:
https://storj.io/
FAIL (2025-07-14 23:19:26 UTC)
orbiter warning: Get "https://storj.io/": dial tcp: lookup storj.io on 127.0.0.1:53: read udp 127.0.0.1:55551->127.0.0.1:53: i/o timeout
Duration: 47.484505ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [X.........X.................................................]
duration:
1.861759873s
FAIL (2025-07-14 23:19:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.861800152s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................]
duration:
41.294398ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-07-14 23:19:22 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp: lookup uptime-checks-us-select.s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:42056->127.0.0.1:53: i/o timeout
Duration: 41.392387ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................]
duration:
707.488575ms
target:
https://ap1.storj.io/login
FAIL (2025-07-14 23:19:22 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:45980->127.0.0.1:53: i/o timeout
Duration: 707.534789ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
4.802827853s
FAIL (2025-07-14 23:19:21 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.80288239s core uplink ap1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
31.208479ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:19:20 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44115->127.0.0.1:53: i/o timeout
Duration: 31.232927ms core satellite us1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X......................X...........]
duration:
250.857143ms
target:
https://eu1.storj.io/login
FAIL (2025-07-14 23:19:18 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp: lookup eu1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:38618->127.0.0.1:53: i/o timeout
Duration: 250.877678ms core satellite eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......................................XX....................]
duration:
303.275444ms
FAIL (2025-07-14 23:19:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 303.293716ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
349.68ms
FAIL (2025-07-14 23:19:12 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:36013->127.0.0.1:53: i/o timeout
Duration: 349.718626ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................]
duration:
593.148461ms
FAIL (2025-07-14 23:19:10 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: rpc: tcp connector failed: rpc: context deadline exceeded
======LOGS======
RequestItem_ObjectBegin
Jul 14 22:33:20.920268234 (517h21m47.84656293s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:33:20.956049835 (517h21m47.882344525s) [seg_pos={0 0}, upload=414055]: Begin upload segment...
Jul 14 22:33:20.956138063 (517h21m47.882432739s) [seg_pos={0 0}, upload=414055]: Done begin upload segment.
Jul 14 22:33:20.956148696 (517h21m47.88244339s) [noise=true , address=104.36.82.19:4432    , piece_id=ZNUQB26NCFHHETSPPLIX52BSR23AI2VO3J2BJA5O4FPUDRD6ILEA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.956179183 (517h21m47.882473875s) [noise=true , address=45.91.95.4:4001      , piece_id=C4KRMZGJX4PWVYSTRKXHCRK34AABH2ZLHVXXRKADJIOFOXX45LTA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.956739778 (517h21m47.883034473s) [noise=true , address=104.36.82.17:4334    , piece_id=6QFH4V2XP5HENEXYSPBLCGWESKAO2M7S243GVWQCSGYYANMDC5BQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957112661 (517h21m47.883407356s) [noise=true , address=45.91.116.14:4215    , piece_id=JB6J36RX7ZLVP4SBF3ZOJSXEZWILQXZOFUQON5WIWMRIAFDZYARA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957321762 (517h21m47.883616454s) [noise=true , address=77.90.31.19:4873     , piece_id=ALRBAJG2MS2FX2JQQORO5ZLLXGFQGMBIXLKRTQB3OKIICVAAQTKA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957534791 (517h21m47.883829483s) [noise=true , address=104.36.82.51:4074    , piece_id=HOC7FQM2ROFQMQOOQMXPD5HVLON2C6U2UVSS5HMLGRIWJIIO3MUQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957685297 (517h21m47.883979986s) [noise=true , address=45.91.116.10:4098    , piece_id=QAD3V2YB62ZWM7NR5YTZD5YBHIZONG64A27OM6C7WS6R6XE5IAKA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957863790 (517h21m47.884158483s) [noise=true , address=77.90.31.18:4810     , piece_id=L2G6QQTX3FVYCW7Z7FMLM6SAA7XZI64BRADRPCOUBLBRVL223KWQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958078206 (517h21m47.884372898s) [noise=true , address=77.90.31.11:4556     , piece_id=4WXTBJSV6F4WCYX3ETHYA7LKJEHEAFNNOD7E5X6GY65ZYUYEAC3A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958206699 (517h21m47.884501391s) [noise=true , address=45.91.116.6:4005     , piece_id=KZTESMI5CMWF5U7S6PXTUK5Z4HSVSXXA6CJ2VAVL5SLK2IVJG3DQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958449262 (517h21m47.884743949s) [noise=true , address=104.36.82.10:4101    , piece_id=6I325W4T6GYA7B6TXAEA33PGTNXQSWH5AB6MRRWPJM6O66LXTDAA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958598885 (517h21m47.884893577s) [noise=true , address=45.91.95.3:4028      , piece_id=WPAZ53X2MORZF3ZAL42BEZW2HQ2FC7YEBX7YGGFNLOBALDZB7JUQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958933707 (517h21m47.885228398s) [noise=true , address=77.90.31.15:4704     , piece_id=K7MIP54PNDQCEH6FKFEHFDYAYQ2ZWOHHARJ26JJYLD6YKJCRX64A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.959332655 (517h21m47.885627352s) [noise=true , address=77.90.31.12:4604     , piece_id=ZCE56GJ3B52UXNUIYQ6CFVR2CGCXDKZYXGY5CWY5235HAQHXRX6A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.959715836 (517h21m47.886010533s) [noise=true , address=45.91.116.10:4111    , piece_id=LCZSVS34DIVD4LVRF73L6ATATHWMR4DVJQ4GN3HADJSZTPLCFBTA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960115490 (517h21m47.886410182s) [noise=true , address=45.91.95.2:4005      , piece_id=XTY4LNMWW23XE7HEZ6GB2WOS37K3ZAOMY2EVCHIQLDB6IQDMWZ6A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960349946 (517h21m47.886644642s) [noise=true , address=77.90.31.14:4694     , piece_id=GXYYM54EJCQQHN7UNLTOP52UVHPQ2E7I36ETL64JMQWH6FT5KEGA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960857778 (517h21m47.88715247s) [noise=true , address=104.36.82.34:4562    , piece_id=HZ7BIXYA7TOMLS3ANW4SSS5WTPOYTRF6JOKO26KJR6TMBSJJPA4Q, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:21.054689329 (517h21m47.980984015s) [upload=414055]: Next returned nil segment
Jul 14 22:33:21.054703519 (517h21m47.980998192s) [upload=414055]: Waiting for error group managing segments...
Jul 14 22:33:21.067731227 (517h21m47.994025919s) [noise=true , address=104.36.82.34:4562    , piece_id=HZ7BIXYA7TOMLS3ANW4SSS5WTPOYTRF6JOKO26KJR6TMBSJJPA4Q, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.068562910 (517h21m47.994857586s) [noise=true , address=77.90.31.18:4810     , piece_id=L2G6QQTX3FVYCW7Z7FMLM6SAA7XZI64BRADRPCOUBLBRVL223KWQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.070198720 (517h21m47.996493396s) [noise=true , address=45.91.116.10:4111    , piece_id=LCZSVS34DIVD4LVRF73L6ATATHWMR4DVJQ4GN3HADJSZTPLCFBTA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.071365233 (517h21m47.997659906s) [noise=true , address=45.91.116.14:4215    , piece_id=JB6J36RX7ZLVP4SBF3ZOJSXEZWILQXZOFUQON5WIWMRIAFDZYARA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.071792066 (517h21m47.998086738s) [noise=true , address=45.91.116.6:4005     , piece_id=KZTESMI5CMWF5U7S6PXTUK5Z4HSVSXXA6CJ2VAVL5SLK2IVJG3DQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.074850939 (517h21m48.001145615s) [noise=true , address=77.90.31.11:4556     , piece_id=4WXTBJSV6F4WCYX3ETHYA7LKJEHEAFNNOD7E5X6GY65ZYUYEAC3A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.075297712 (517h21m48.001592384s) [noise=true , address=45.91.116.10:4098    , piece_id=QAD3V2YB62ZWM7NR5YTZD5YBHIZONG64A27OM6C7WS6R6XE5IAKA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.076301394 (517h21m48.002596084s) [noise=true , address=104.36.82.17:4334    , piece_id=6QFH4V2XP5HENEXYSPBLCGWESKAO2M7S243GVWQCSGYYANMDC5BQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.078308059 (517h21m48.00460275s) [noise=true , address=104.36.82.19:4432    , piece_id=ZNUQB26NCFHHETSPPLIX52BSR23AI2VO3J2BJA5O4FPUDRD6ILEA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.079380196 (517h21m48.005674875s) [noise=true , address=77.90.31.14:4694     , piece_id=GXYYM54EJCQQHN7UNLTOP52UVHPQ2E7I36ETL64JMQWH6FT5KEGA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.086892708 (517h21m48.013187388s) [noise=true , address=104.36.82.10:4101    , piece_id=6I325W4T6GYA7B6TXAEA33PGTNXQSWH5AB6MRRWPJM6O66LXTDAA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.096904024 (517h21m48.023198705s) [noise=true , address=77.90.31.19:4873     , piece_id=ALRBAJG2MS2FX2JQQORO5ZLLXGFQGMBIXLKRTQB3OKIICVAAQTKA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.097936100 (517h21m48.024230776s) [noise=true , address=77.90.31.12:4604     , piece_id=ZCE56GJ3B52UXNUIYQ6CFVR2CGCXDKZYXGY5CWY5235HAQHXRX6A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.107109151 (517h21m48.03340383s) [noise=true , address=77.90.31.15:4704     , piece_id=K7MIP54PNDQCEH6FKFEHFDYAYQ2ZWOHHARJ26JJYLD6YKJCRX64A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.107140287 (517h21m48.033434963s) [seg_pos={0 0}, upload=414055]: Segment reached optimal threshold of 14 pieces.
Jul 14 22:33:21.107798713 (517h21m48.034093407s) [noise=true , address=45.91.95.2:4005      , piece_id=XTY4LNMWW23XE7HEZ6GB2WOS37K3ZAOMY2EVCHIQLDB6IQDMWZ6A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bxFpBmz99gV4rL6bMtnHuthK2Xg4EusbfMAWF37RTRtPkqhQS): protocol: context canceled
Jul 14 22:33:21.107904677 (517h21m48.034199363s) [noise=true , address=104.36.82.51:4074    , piece_id=HOC7FQM2ROFQMQOOQMXPD5HVLON2C6U2UVSS5HMLGRIWJIIO3MUQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DBQpuE1EC1ENCy67We5QhMT6zsa2AbeMDSv8hmQLjokGRvoxc): protocol: write tcp 159.223.143.39:44794->104.36.82.51:4074: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 14 22:33:21.107928716 (517h21m48.034223405s) [noise=true , address=45.91.95.3:4028      , piece_id=WPAZ53X2MORZF3ZAL42BEZW2HQ2FC7YEBX7YGGFNLOBALDZB7JUQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Cn2vydXYjCSFYkLuBck57avzeCstHowf3cDQwtYn2RV2Wskh2): protocol: write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection; write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection
Jul 14 22:33:21.108008084 (517h21m48.034302763s) [noise=true , address=45.91.95.4:4001      , piece_id=C4KRMZGJX4PWVYSTRKXHCRK34AABH2ZLHVXXRKADJIOFOXX45LTA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PdimTdB4ysD3SQ8hKMAGAXkzzC71irLv6rW9FArf5qmrvZ5MY): protocol: read tcp 159.223.143.39:55404->45.91.95.4:4001: use of closed network connection; context canceled
Jul 14 22:33:21.108022527 (517h21m48.034317213s) [seg_pos={0 0}, upload=414055]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 14 22:33:21.108148869 (517h21m48.034443556s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:33:21.108154867 (517h21m48.034449552s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:33:21.175128505 (517h21m48.101423192s) [upload=414055]: Done uploading segments...
Jul 14 22:33:21.175148328 (517h21m48.101443004s) [upload=414055]: Upload finished. err: <nil>
Duration: 593.177102ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.X..................X.......................................]
duration:
929.796859ms
FAIL (2025-07-14 23:19:09 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 929.828024ms core uplink eu1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)
antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................]
duration:
250.962063ms
target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 23:19:05 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": dial tcp: lookup www.storj-ipfs.com on 127.0.0.1:53: read udp 127.0.0.1:54967->127.0.0.1:53: i/o timeout
Duration: 250.985334ms edge ipfs us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
3 out of 60 is failed (threshold=6) [...........XX......................................X........]
duration:
35.943395ms
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
FAIL (2025-07-14 23:19:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:60313->127.0.0.1:53: i/o timeout
Duration: 35.974459ms edge linksharing bgp us1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
3 out of 60 is failed (threshold=3) [....X...XX..................................................]
duration:
22.605414ms
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-07-14 23:19:03 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:59356->127.0.0.1:53: i/o timeout
Duration: 22.649167ms edge linksharing us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
33.236899ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:19:03 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44115->127.0.0.1:53: i/o timeout
Duration: 33.352715ms core satellite us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip:
4 out of 60 is failed (threshold=6) [..X..X........X.....................................X.......]
duration:
749.344317ms
target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-07-14 23:18:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:44806->127.0.0.1:53: i/o timeout
Duration: 749.379497ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
2.030772703s
FAIL (2025-07-14 23:18:57 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.030805633s core uplink ap1
checkers.HTTP{"GET" "https://storj.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.storj_io)
antiblip:
2 out of 15 is failed (threshold=6) [......XX.......]
duration:
74.182872ms
target:
https://storj.io/
FAIL (2025-07-14 23:18:53 UTC)
orbiter warning: Get "https://storj.io/": dial tcp: lookup storj.io on 127.0.0.1:53: read udp 127.0.0.1:55551->127.0.0.1:53: i/o timeout
Duration: 74.205896ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................]
duration:
466.630025ms
FAIL (2025-07-14 23:18:52 UTC)
orbiter warning: 
======ERROR======
uplink: bucket: metaclient: rpc: tcp connector failed: rpc: context deadline exceeded
======LOGS======
RequestItem_ObjectBegin
Jul 14 22:33:20.920268234 (517h21m47.84656293s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 14 22:33:20.956049835 (517h21m47.882344525s) [seg_pos={0 0}, upload=414055]: Begin upload segment...
Jul 14 22:33:20.956138063 (517h21m47.882432739s) [seg_pos={0 0}, upload=414055]: Done begin upload segment.
Jul 14 22:33:20.956148696 (517h21m47.88244339s) [noise=true , address=104.36.82.19:4432    , piece_id=ZNUQB26NCFHHETSPPLIX52BSR23AI2VO3J2BJA5O4FPUDRD6ILEA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.956179183 (517h21m47.882473875s) [noise=true , address=45.91.95.4:4001      , piece_id=C4KRMZGJX4PWVYSTRKXHCRK34AABH2ZLHVXXRKADJIOFOXX45LTA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.956739778 (517h21m47.883034473s) [noise=true , address=104.36.82.17:4334    , piece_id=6QFH4V2XP5HENEXYSPBLCGWESKAO2M7S243GVWQCSGYYANMDC5BQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957112661 (517h21m47.883407356s) [noise=true , address=45.91.116.14:4215    , piece_id=JB6J36RX7ZLVP4SBF3ZOJSXEZWILQXZOFUQON5WIWMRIAFDZYARA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957321762 (517h21m47.883616454s) [noise=true , address=77.90.31.19:4873     , piece_id=ALRBAJG2MS2FX2JQQORO5ZLLXGFQGMBIXLKRTQB3OKIICVAAQTKA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957534791 (517h21m47.883829483s) [noise=true , address=104.36.82.51:4074    , piece_id=HOC7FQM2ROFQMQOOQMXPD5HVLON2C6U2UVSS5HMLGRIWJIIO3MUQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957685297 (517h21m47.883979986s) [noise=true , address=45.91.116.10:4098    , piece_id=QAD3V2YB62ZWM7NR5YTZD5YBHIZONG64A27OM6C7WS6R6XE5IAKA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.957863790 (517h21m47.884158483s) [noise=true , address=77.90.31.18:4810     , piece_id=L2G6QQTX3FVYCW7Z7FMLM6SAA7XZI64BRADRPCOUBLBRVL223KWQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958078206 (517h21m47.884372898s) [noise=true , address=77.90.31.11:4556     , piece_id=4WXTBJSV6F4WCYX3ETHYA7LKJEHEAFNNOD7E5X6GY65ZYUYEAC3A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958206699 (517h21m47.884501391s) [noise=true , address=45.91.116.6:4005     , piece_id=KZTESMI5CMWF5U7S6PXTUK5Z4HSVSXXA6CJ2VAVL5SLK2IVJG3DQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958449262 (517h21m47.884743949s) [noise=true , address=104.36.82.10:4101    , piece_id=6I325W4T6GYA7B6TXAEA33PGTNXQSWH5AB6MRRWPJM6O66LXTDAA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958598885 (517h21m47.884893577s) [noise=true , address=45.91.95.3:4028      , piece_id=WPAZ53X2MORZF3ZAL42BEZW2HQ2FC7YEBX7YGGFNLOBALDZB7JUQ, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.958933707 (517h21m47.885228398s) [noise=true , address=77.90.31.15:4704     , piece_id=K7MIP54PNDQCEH6FKFEHFDYAYQ2ZWOHHARJ26JJYLD6YKJCRX64A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.959332655 (517h21m47.885627352s) [noise=true , address=77.90.31.12:4604     , piece_id=ZCE56GJ3B52UXNUIYQ6CFVR2CGCXDKZYXGY5CWY5235HAQHXRX6A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.959715836 (517h21m47.886010533s) [noise=true , address=45.91.116.10:4111    , piece_id=LCZSVS34DIVD4LVRF73L6ATATHWMR4DVJQ4GN3HADJSZTPLCFBTA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960115490 (517h21m47.886410182s) [noise=true , address=45.91.95.2:4005      , piece_id=XTY4LNMWW23XE7HEZ6GB2WOS37K3ZAOMY2EVCHIQLDB6IQDMWZ6A, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960349946 (517h21m47.886644642s) [noise=true , address=77.90.31.14:4694     , piece_id=GXYYM54EJCQQHN7UNLTOP52UVHPQ2E7I36ETL64JMQWH6FT5KEGA, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:20.960857778 (517h21m47.88715247s) [noise=true , address=104.36.82.34:4562    , piece_id=HZ7BIXYA7TOMLS3ANW4SSS5WTPOYTRF6JOKO26KJR6TMBSJJPA4Q, seg_pos={0 0}, upload=414055]: Uploading piece...
Jul 14 22:33:21.054689329 (517h21m47.980984015s) [upload=414055]: Next returned nil segment
Jul 14 22:33:21.054703519 (517h21m47.980998192s) [upload=414055]: Waiting for error group managing segments...
Jul 14 22:33:21.067731227 (517h21m47.994025919s) [noise=true , address=104.36.82.34:4562    , piece_id=HZ7BIXYA7TOMLS3ANW4SSS5WTPOYTRF6JOKO26KJR6TMBSJJPA4Q, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.068562910 (517h21m47.994857586s) [noise=true , address=77.90.31.18:4810     , piece_id=L2G6QQTX3FVYCW7Z7FMLM6SAA7XZI64BRADRPCOUBLBRVL223KWQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.070198720 (517h21m47.996493396s) [noise=true , address=45.91.116.10:4111    , piece_id=LCZSVS34DIVD4LVRF73L6ATATHWMR4DVJQ4GN3HADJSZTPLCFBTA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.071365233 (517h21m47.997659906s) [noise=true , address=45.91.116.14:4215    , piece_id=JB6J36RX7ZLVP4SBF3ZOJSXEZWILQXZOFUQON5WIWMRIAFDZYARA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.071792066 (517h21m47.998086738s) [noise=true , address=45.91.116.6:4005     , piece_id=KZTESMI5CMWF5U7S6PXTUK5Z4HSVSXXA6CJ2VAVL5SLK2IVJG3DQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.074850939 (517h21m48.001145615s) [noise=true , address=77.90.31.11:4556     , piece_id=4WXTBJSV6F4WCYX3ETHYA7LKJEHEAFNNOD7E5X6GY65ZYUYEAC3A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.075297712 (517h21m48.001592384s) [noise=true , address=45.91.116.10:4098    , piece_id=QAD3V2YB62ZWM7NR5YTZD5YBHIZONG64A27OM6C7WS6R6XE5IAKA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.076301394 (517h21m48.002596084s) [noise=true , address=104.36.82.17:4334    , piece_id=6QFH4V2XP5HENEXYSPBLCGWESKAO2M7S243GVWQCSGYYANMDC5BQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.078308059 (517h21m48.00460275s) [noise=true , address=104.36.82.19:4432    , piece_id=ZNUQB26NCFHHETSPPLIX52BSR23AI2VO3J2BJA5O4FPUDRD6ILEA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.079380196 (517h21m48.005674875s) [noise=true , address=77.90.31.14:4694     , piece_id=GXYYM54EJCQQHN7UNLTOP52UVHPQ2E7I36ETL64JMQWH6FT5KEGA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.086892708 (517h21m48.013187388s) [noise=true , address=104.36.82.10:4101    , piece_id=6I325W4T6GYA7B6TXAEA33PGTNXQSWH5AB6MRRWPJM6O66LXTDAA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.096904024 (517h21m48.023198705s) [noise=true , address=77.90.31.19:4873     , piece_id=ALRBAJG2MS2FX2JQQORO5ZLLXGFQGMBIXLKRTQB3OKIICVAAQTKA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.097936100 (517h21m48.024230776s) [noise=true , address=77.90.31.12:4604     , piece_id=ZCE56GJ3B52UXNUIYQ6CFVR2CGCXDKZYXGY5CWY5235HAQHXRX6A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.107109151 (517h21m48.03340383s) [noise=true , address=77.90.31.15:4704     , piece_id=K7MIP54PNDQCEH6FKFEHFDYAYQ2ZWOHHARJ26JJYLD6YKJCRX64A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: <nil>
Jul 14 22:33:21.107140287 (517h21m48.033434963s) [seg_pos={0 0}, upload=414055]: Segment reached optimal threshold of 14 pieces.
Jul 14 22:33:21.107798713 (517h21m48.034093407s) [noise=true , address=45.91.95.2:4005      , piece_id=XTY4LNMWW23XE7HEZ6GB2WOS37K3ZAOMY2EVCHIQLDB6IQDMWZ6A, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bxFpBmz99gV4rL6bMtnHuthK2Xg4EusbfMAWF37RTRtPkqhQS): protocol: context canceled
Jul 14 22:33:21.107904677 (517h21m48.034199363s) [noise=true , address=104.36.82.51:4074    , piece_id=HOC7FQM2ROFQMQOOQMXPD5HVLON2C6U2UVSS5HMLGRIWJIIO3MUQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DBQpuE1EC1ENCy67We5QhMT6zsa2AbeMDSv8hmQLjokGRvoxc): protocol: write tcp 159.223.143.39:44794->104.36.82.51:4074: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 14 22:33:21.107928716 (517h21m48.034223405s) [noise=true , address=45.91.95.3:4028      , piece_id=WPAZ53X2MORZF3ZAL42BEZW2HQ2FC7YEBX7YGGFNLOBALDZB7JUQ, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Cn2vydXYjCSFYkLuBck57avzeCstHowf3cDQwtYn2RV2Wskh2): protocol: write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection; write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:33072->45.91.95.3:4028: use of closed network connection
Jul 14 22:33:21.108008084 (517h21m48.034302763s) [noise=true , address=45.91.95.4:4001      , piece_id=C4KRMZGJX4PWVYSTRKXHCRK34AABH2ZLHVXXRKADJIOFOXX45LTA, seg_pos={0 0}, upload=414055]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PdimTdB4ysD3SQ8hKMAGAXkzzC71irLv6rW9FArf5qmrvZ5MY): protocol: read tcp 159.223.143.39:55404->45.91.95.4:4001: use of closed network connection; context canceled
Jul 14 22:33:21.108022527 (517h21m48.034317213s) [seg_pos={0 0}, upload=414055]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jul 14 22:33:21.108148869 (517h21m48.034443556s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 14 22:33:21.108154867 (517h21m48.034449552s) [upload=414055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 14 22:33:21.175128505 (517h21m48.101423192s) [upload=414055]: Done uploading segments...
Jul 14 22:33:21.175148328 (517h21m48.101443004s) [upload=414055]: Upload finished. err: <nil>
Duration: 466.674659ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................XX...................]
duration:
275.034188ms
FAIL (2025-07-14 23:18:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 275.062285ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [....X.................X........................X............]
duration:
2.693304046s
FAIL (2025-07-14 23:18:48 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.693334393s core uplink eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
3 out of 60 is failed (threshold=6) [..X.X.............................................X.........]
duration:
99.821215ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-14 23:18:46 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:60313->127.0.0.1:53: i/o timeout
Duration: 99.867621ms edge linksharing bgp eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................]
duration:
195.264271ms
FAIL (2025-07-14 23:18:45 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:36013->127.0.0.1:53: i/o timeout
Duration: 195.310349ms edge authservice http bgp us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
29.656532ms
target:
https://us1.storj.io/login
FAIL (2025-07-14 23:18:44 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:44115->127.0.0.1:53: i/o timeout
Duration: 29.678718ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [XX.........X................................................]
duration:
1.9946056s
FAIL (2025-07-14 23:18:43 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.994644988s core uplink us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)
antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................]
duration:
234.752535ms
target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-14 23:18:38 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": dial tcp: lookup www.storj-ipfs.com on 127.0.0.1:53: read udp 127.0.0.1:54967->127.0.0.1:53: i/o timeout
Duration: 234.783109ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
366.850957ms
target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-14 23:18:37 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": dial tcp: lookup www.storj-ipfs.com on 127.0.0.1:53: read udp 127.0.0.1:40713->127.0.0.1:53: i/o timeout
Duration: 366.882971ms edge ipfs us1