Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.826150553s
FAIL (2025-07-15 00:50:22 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.826184444s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
262.594403ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:50:20 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 262.623697ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
728.254908ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:50:17 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 728.28241ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.872773151s
FAIL (2025-07-15 00:50:09 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.872804978s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
5.832429207s
FAIL (2025-07-15 00:50:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 5.832461409s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
10.001531322s
FAIL (2025-07-15 00:50:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:33627->127.0.0.1:53: i/o timeout
Duration: 10.001557089s
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
10.002356611s
FAIL (2025-07-15 00:49:55 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56502->127.0.0.1:53: i/o timeout
Duration: 10.002390416s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.802257883s
FAIL (2025-07-15 00:49:48 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.802318321s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
256.540602ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:49:45 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 256.562836ms
edge
gateway
vhost
bgp
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
342.212613ms
FAIL (2025-07-15 00:49:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:52448->127.0.0.1:53: i/o timeout
Duration: 342.236483ms
edge
authservice
http
bgp
eu1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
160.384855ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:49:37 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:33324->127.0.0.1:53: i/o timeout
Duration: 160.410991ms
core
satellite
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
33.362835ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:49:37 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 33.407432ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
116.820348ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:49:36 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 116.84361ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
598.23982ms
FAIL (2025-07-15 00:49:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
piece_id=4XIRWFKYZRXVBIDDGKFCV6PZILBBGHWVDQCOV7LDQE6M4KVCENZA, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.990999751 (519h14m31.917294441s) [noise=true , address=104.36.82.10:4077 , piece_id=H3FXODESAOUQMFKTPDUTKVVCN26E4BJJ6RK3L4FK4BDKDPK2IDPQ, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.994234922 (519h14m31.920529612s) [seg_pos={0 0}, upload=415540]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 15 00:26:04.994412732 (519h14m31.92070742s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:04.994419991 (519h14m31.920714669s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:05.052077449 (519h14m31.978372155s) [upload=415540]: Done uploading segments...
Jul 15 00:26:05.052103421 (519h14m31.978398125s) [upload=415540]: Upload finished. err: <nil>
Jul 15 00:26:38.958141934 (519h15m5.884436612s) [upload=415547]: Starting upload
Jul 15 00:26:38.958201231 (519h15m5.884495926s) [upload=415547]: Done starting upload
Jul 15 00:26:38.958314419 (519h15m5.884609106s) [upload=415547]: Uploading segments...
Jul 15 00:26:38.958527717 (519h15m5.884822403s) [upload=415547]: Got next segment. Inline: false
Jul 15 00:26:38.958568846 (519h15m5.884863531s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:26:38.958574194 (519h15m5.884868881s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:26:38.983569545 (519h15m5.909864232s) [seg_pos={0 0}, upload=415547]: Begin upload segment...
Jul 15 00:26:38.983616193 (519h15m5.909910881s) [seg_pos={0 0}, upload=415547]: Done begin upload segment.
Jul 15 00:26:38.983654916 (519h15m5.909949609s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.984140706 (519h15m5.910435399s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985394041 (519h15m5.911688736s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985448268 (519h15m5.911742957s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.986646166 (519h15m5.912940863s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.987790595 (519h15m5.914085293s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.990052347 (519h15m5.916347044s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.992712744 (519h15m5.919007436s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993046170 (519h15m5.919340862s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993293420 (519h15m5.919588107s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993559008 (519h15m5.919853696s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998405965 (519h15m5.92470064s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998757342 (519h15m5.925052034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.008233673 (519h15m5.934528364s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.014122054 (519h15m5.940416728s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.018124788 (519h15m5.944419475s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.091207534 (519h15m6.01750222s) [upload=415547]: Next returned nil segment
Jul 15 00:26:39.091223696 (519h15m6.017518383s) [upload=415547]: Waiting for error group managing segments...
Jul 15 00:26:39.092995382 (519h15m6.019290055s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094440372 (519h15m6.02073505s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094889705 (519h15m6.021184385s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095463738 (519h15m6.021758418s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095885481 (519h15m6.022180168s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.096458464 (519h15m6.022753154s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097271208 (519h15m6.023565885s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097390539 (519h15m6.023685219s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099260264 (519h15m6.025554945s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099412522 (519h15m6.025707203s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099786150 (519h15m6.026080838s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.102454228 (519h15m6.028748916s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104208070 (519h15m6.030502749s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104226636 (519h15m6.030521322s) [seg_pos={0 0}, upload=415547]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:26:39.104335264 (519h15m6.030629951s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104553329 (519h15m6.030848017s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104574593 (519h15m6.030869266s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: rpc: dial tcp 104.36.82.11:4114: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 15 00:26:39.104611772 (519h15m6.030906482s) [seg_pos={0 0}, upload=415547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:26:39.104702706 (519h15m6.030997398s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:39.104708334 (519h15m6.031003021s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:39.153946432 (519h15m6.080241109s) [upload=415547]: Done uploading segments...
Jul 15 00:26:39.153985991 (519h15m6.080280681s) [upload=415547]: Upload finished. err: <nil>
Duration: 598.270678ms
core
uplink
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
375.896816ms
FAIL (2025-07-15 00:49:22 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:52448->127.0.0.1:53: i/o timeout
Duration: 375.94054ms
edge
authservice
http
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.732946677s
FAIL (2025-07-15 00:49:17 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.732979472s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
829.031802ms
FAIL (2025-07-15 00:49:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38663->127.0.0.1:53: i/o timeout
Duration: 829.056726ms
edge
authservice
http
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
103.850202ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:49:16 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 103.881196ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
724.930047ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:49:14 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 724.956962ms
core
satellite
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
838.642089ms
FAIL (2025-07-15 00:48:59 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38663->127.0.0.1:53: i/o timeout
Duration: 838.673801ms
edge
authservice
http
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.07548302s
FAIL (2025-07-15 00:48:58 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 2.075516255s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
36.179732ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:48:53 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 36.203699ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
747.731005ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:48:49 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 747.754082ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
490.005412ms
FAIL (2025-07-15 00:48:49 UTC)
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_us_0/4M?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:52819->127.0.0.1:53: i/o timeout
Duration: 490.029737ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
480.914481ms
FAIL (2025-07-15 00:48:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
piece_id=4XIRWFKYZRXVBIDDGKFCV6PZILBBGHWVDQCOV7LDQE6M4KVCENZA, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.990999751 (519h14m31.917294441s) [noise=true , address=104.36.82.10:4077 , piece_id=H3FXODESAOUQMFKTPDUTKVVCN26E4BJJ6RK3L4FK4BDKDPK2IDPQ, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.994234922 (519h14m31.920529612s) [seg_pos={0 0}, upload=415540]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 15 00:26:04.994412732 (519h14m31.92070742s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:04.994419991 (519h14m31.920714669s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:05.052077449 (519h14m31.978372155s) [upload=415540]: Done uploading segments...
Jul 15 00:26:05.052103421 (519h14m31.978398125s) [upload=415540]: Upload finished. err: <nil>
Jul 15 00:26:38.958141934 (519h15m5.884436612s) [upload=415547]: Starting upload
Jul 15 00:26:38.958201231 (519h15m5.884495926s) [upload=415547]: Done starting upload
Jul 15 00:26:38.958314419 (519h15m5.884609106s) [upload=415547]: Uploading segments...
Jul 15 00:26:38.958527717 (519h15m5.884822403s) [upload=415547]: Got next segment. Inline: false
Jul 15 00:26:38.958568846 (519h15m5.884863531s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:26:38.958574194 (519h15m5.884868881s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:26:38.983569545 (519h15m5.909864232s) [seg_pos={0 0}, upload=415547]: Begin upload segment...
Jul 15 00:26:38.983616193 (519h15m5.909910881s) [seg_pos={0 0}, upload=415547]: Done begin upload segment.
Jul 15 00:26:38.983654916 (519h15m5.909949609s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.984140706 (519h15m5.910435399s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985394041 (519h15m5.911688736s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985448268 (519h15m5.911742957s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.986646166 (519h15m5.912940863s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.987790595 (519h15m5.914085293s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.990052347 (519h15m5.916347044s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.992712744 (519h15m5.919007436s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993046170 (519h15m5.919340862s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993293420 (519h15m5.919588107s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993559008 (519h15m5.919853696s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998405965 (519h15m5.92470064s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998757342 (519h15m5.925052034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.008233673 (519h15m5.934528364s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.014122054 (519h15m5.940416728s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.018124788 (519h15m5.944419475s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.091207534 (519h15m6.01750222s) [upload=415547]: Next returned nil segment
Jul 15 00:26:39.091223696 (519h15m6.017518383s) [upload=415547]: Waiting for error group managing segments...
Jul 15 00:26:39.092995382 (519h15m6.019290055s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094440372 (519h15m6.02073505s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094889705 (519h15m6.021184385s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095463738 (519h15m6.021758418s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095885481 (519h15m6.022180168s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.096458464 (519h15m6.022753154s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097271208 (519h15m6.023565885s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097390539 (519h15m6.023685219s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099260264 (519h15m6.025554945s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099412522 (519h15m6.025707203s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099786150 (519h15m6.026080838s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.102454228 (519h15m6.028748916s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104208070 (519h15m6.030502749s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104226636 (519h15m6.030521322s) [seg_pos={0 0}, upload=415547]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:26:39.104335264 (519h15m6.030629951s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104553329 (519h15m6.030848017s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104574593 (519h15m6.030869266s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: rpc: dial tcp 104.36.82.11:4114: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 15 00:26:39.104611772 (519h15m6.030906482s) [seg_pos={0 0}, upload=415547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:26:39.104702706 (519h15m6.030997398s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:39.104708334 (519h15m6.031003021s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:39.153946432 (519h15m6.080241109s) [upload=415547]: Done uploading segments...
Jul 15 00:26:39.153985991 (519h15m6.080280681s) [upload=415547]: Upload finished. err: <nil>
Duration: 480.94674ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
30.151792ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:48:26 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:33324->127.0.0.1:53: i/o timeout
Duration: 30.179557ms
core
satellite
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.768404137s
FAIL (2025-07-15 00:48:25 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.768438186s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
272.305749ms
FAIL (2025-07-15 00:48:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 272.325428ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.740572498s
FAIL (2025-07-15 00:48:22 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.740618642s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
348.221339ms
FAIL (2025-07-15 00:48:21 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:52448->127.0.0.1:53: i/o timeout
Duration: 348.252044ms
edge
authservice
http
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [...............................XX...........................] duration:
257.69229ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:48:19 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 257.716323ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
104.070611ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:48:15 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 104.100774ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
46.114447ms target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
FAIL (2025-07-15 00:48:10 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:51559->127.0.0.1:53: i/o timeout
Duration: 46.138956ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
276.265228ms
FAIL (2025-07-15 00:48:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 276.298647ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
32.079768ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:48:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 32.107869ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
727.147653ms target:
https://ap1.storj.io/login
FAIL (2025-07-15 00:48:03 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp: lookup ap1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:41401->127.0.0.1:53: i/o timeout
Duration: 727.199042ms
core
satellite
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
495.94431ms
FAIL (2025-07-15 00:48:01 UTC)
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_us_0/4M?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:52819->127.0.0.1:53: i/o timeout
Duration: 495.977214ms
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
837.879803ms
FAIL (2025-07-15 00:47:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:38663->127.0.0.1:53: i/o timeout
Duration: 837.925621ms
edge
authservice
http
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [................................XX..........................] duration:
748.779636ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-07-15 00:47:48 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:56875->127.0.0.1:53: i/o timeout
Duration: 748.80801ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
445.173551ms
FAIL (2025-07-15 00:47:46 UTC)
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/gateway-tests/from_do_prod_ops_orbiter_us_0/4M?x-id=PutObject": dial tcp: lookup s3.us-select-1.storjapi.io on 127.0.0.1:53: read udp 127.0.0.1:52819->127.0.0.1:53: i/o timeout
Duration: 445.196833ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
28.442304ms target:
https://us1.storj.io/login
FAIL (2025-07-15 00:47:39 UTC)
orbiter warning: Get "https://us1.storj.io/login": dial tcp: lookup us1.storj.io on 127.0.0.1:53: read udp 127.0.0.1:33324->127.0.0.1:53: i/o timeout
Duration: 28.467926ms
core
satellite
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.816853022s
FAIL (2025-07-15 00:47:37 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 4.816907161s
core
uplink
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
260.185824ms
FAIL (2025-07-15 00:47:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 260.208377ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.887121629s
FAIL (2025-07-15 00:47:34 UTC)
orbiter warning: uplink: bucket: metaclient: context deadline exceeded
Duration: 1.887148674s
core
uplink
us1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
434.40342ms
FAIL (2025-07-15 00:47:33 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:52448->127.0.0.1:53: i/o timeout
Duration: 434.432122ms
edge
authservice
http
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
394.376612ms
FAIL (2025-07-15 00:47:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
piece_id=4XIRWFKYZRXVBIDDGKFCV6PZILBBGHWVDQCOV7LDQE6M4KVCENZA, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.990999751 (519h14m31.917294441s) [noise=true , address=104.36.82.10:4077 , piece_id=H3FXODESAOUQMFKTPDUTKVVCN26E4BJJ6RK3L4FK4BDKDPK2IDPQ, seg_pos={0 0}, upload=415540]: Done uploading piece. err: <nil>
Jul 15 00:26:04.994234922 (519h14m31.920529612s) [seg_pos={0 0}, upload=415540]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jul 15 00:26:04.994412732 (519h14m31.92070742s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:04.994419991 (519h14m31.920714669s) [upload=415540]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:05.052077449 (519h14m31.978372155s) [upload=415540]: Done uploading segments...
Jul 15 00:26:05.052103421 (519h14m31.978398125s) [upload=415540]: Upload finished. err: <nil>
Jul 15 00:26:38.958141934 (519h15m5.884436612s) [upload=415547]: Starting upload
Jul 15 00:26:38.958201231 (519h15m5.884495926s) [upload=415547]: Done starting upload
Jul 15 00:26:38.958314419 (519h15m5.884609106s) [upload=415547]: Uploading segments...
Jul 15 00:26:38.958527717 (519h15m5.884822403s) [upload=415547]: Got next segment. Inline: false
Jul 15 00:26:38.958568846 (519h15m5.884863531s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 15 00:26:38.958574194 (519h15m5.884868881s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 15 00:26:38.983569545 (519h15m5.909864232s) [seg_pos={0 0}, upload=415547]: Begin upload segment...
Jul 15 00:26:38.983616193 (519h15m5.909910881s) [seg_pos={0 0}, upload=415547]: Done begin upload segment.
Jul 15 00:26:38.983654916 (519h15m5.909949609s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.984140706 (519h15m5.910435399s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985394041 (519h15m5.911688736s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.985448268 (519h15m5.911742957s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.986646166 (519h15m5.912940863s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.987790595 (519h15m5.914085293s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.990052347 (519h15m5.916347044s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.992712744 (519h15m5.919007436s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993046170 (519h15m5.919340862s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993293420 (519h15m5.919588107s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.993559008 (519h15m5.919853696s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998405965 (519h15m5.92470064s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:38.998757342 (519h15m5.925052034s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.008233673 (519h15m5.934528364s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.014122054 (519h15m5.940416728s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.018124788 (519h15m5.944419475s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Uploading piece...
Jul 15 00:26:39.091207534 (519h15m6.01750222s) [upload=415547]: Next returned nil segment
Jul 15 00:26:39.091223696 (519h15m6.017518383s) [upload=415547]: Waiting for error group managing segments...
Jul 15 00:26:39.092995382 (519h15m6.019290055s) [noise=true , address=45.91.116.8:4047 , piece_id=7QUW6XFPJOF3LYCFRQEM53PMW75SXRPGXDVFK4PXZI4POY67W55Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094440372 (519h15m6.02073505s) [noise=true , address=45.91.116.9:4262 , piece_id=BJYOPGMIGLPOIUKBK2BNIHU5S6TOO4HR3SDE6S6G7AE4CUAATLVA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.094889705 (519h15m6.021184385s) [noise=true , address=77.90.31.18:4807 , piece_id=Z3DBSNE46T6YBUUW5PIYS4PXXMXZ7WHGL36GABOZLS5I6C3GH2GA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095463738 (519h15m6.021758418s) [noise=true , address=45.91.116.4:4939 , piece_id=5QJSGVOAGLWNHQSII3HUER5FXDTIKFSM3QWTK3D6THP67JHCSBPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.095885481 (519h15m6.022180168s) [noise=true , address=77.90.31.21:4879 , piece_id=OH2V2GURS6R7PRM5PV6XA2GXYT6HNHWTOWNQ3ECB3KIWDAZ4OMFQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.096458464 (519h15m6.022753154s) [noise=true , address=104.36.82.7:4912 , piece_id=QOET5YXBAK72SODIA22OL3DMTAYT4FFKI7TCJN7WWYSCXPFOQEPA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097271208 (519h15m6.023565885s) [noise=true , address=104.36.82.9:4006 , piece_id=BZFC6MYMRODFHB3KKOYQXQ6HXEOR3SINGLS2ECNNCHQBKASK6E2Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.097390539 (519h15m6.023685219s) [noise=true , address=104.36.82.14:4221 , piece_id=XVKQGIZTDJWZUDR4LCB4PE23Q7GIDPIKOQKU53JTV6CES4QP7VQQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099260264 (519h15m6.025554945s) [noise=true , address=104.36.82.16:4293 , piece_id=FPZA6CZP4VJ42IYRZ2KHPQGXPW24PCYPCIMMGHBKE3GX4DHAFYCQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099412522 (519h15m6.025707203s) [noise=true , address=104.36.82.13:4186 , piece_id=5L5LDUK5DKSD2RQPV55AUDPF7M5NQRQ4BHIO3AIBENXTBQPR5LWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.099786150 (519h15m6.026080838s) [noise=true , address=104.36.82.6:4875 , piece_id=5NNLETCJLLXLX6WGMJOQ47FJ4HVIE5UMABDB4WVMDM67N5E6IEWA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.102454228 (519h15m6.028748916s) [noise=true , address=104.36.82.8:4970 , piece_id=UPRXFKCNOQ7UPZNOOGFMQCTXOKECY7OEQX5A3I36UEJJJI5U46OA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104208070 (519h15m6.030502749s) [noise=true , address=77.90.31.13:4627 , piece_id=WMYEJ6E3S5K3V2VRQBR7RHPZQ7OB5QBN47D2NFB53KRNL2RYZRWQ, seg_pos={0 0}, upload=415547]: Done uploading piece. err: <nil>
Jul 15 00:26:39.104226636 (519h15m6.030521322s) [seg_pos={0 0}, upload=415547]: Segment reached optimal threshold of 13 pieces.
Jul 15 00:26:39.104335264 (519h15m6.030629951s) [noise=true , address=77.90.31.14:4662 , piece_id=3AUSP55MFH4RHKZ6ZS2REI7MBDBLIH22S7ZSHMLLPUAWKARWYI5Q, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104553329 (519h15m6.030848017s) [noise=true , address=77.90.31.16:4734 , piece_id=YTJC6RQRQYOX4ZPXK4HR7JUP5J7HFTUNDTAC7CXISSGC3CLG3HNA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: expected piece hash; context canceled; EOF
Jul 15 00:26:39.104574593 (519h15m6.030869266s) [noise=true , address=104.36.82.11:4114 , piece_id=WE34IJTQCR4CRTJZP3STSG3DVGP7JVNBD4VWN6FGBVNYHRP4CTDA, seg_pos={0 0}, upload=415547]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN): protocol: rpc: dial tcp 104.36.82.11:4114: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 15 00:26:39.104611772 (519h15m6.030906482s) [seg_pos={0 0}, upload=415547]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 15 00:26:39.104702706 (519h15m6.030997398s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 15 00:26:39.104708334 (519h15m6.031003021s) [upload=415547]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 15 00:26:39.153946432 (519h15m6.080241109s) [upload=415547]: Done uploading segments...
Jul 15 00:26:39.153985991 (519h15m6.080280681s) [upload=415547]: Upload finished. err: <nil>
Duration: 394.430846ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
30.801533ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-07-15 00:47:31 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39540->127.0.0.1:53: i/o timeout
Duration: 30.832738ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
106.524955ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
FAIL (2025-07-15 00:47:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:49497->127.0.0.1:53: i/o timeout
Duration: 106.549899ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
617.265737ms
FAIL (2025-07-15 00:47:20 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:47057->127.0.0.1:53: i/o timeout
Duration: 617.294984ms
core
uplink
us-select-1
us1-placement-20
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
157.886531ms
FAIL (2025-07-15 00:47:17 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:52448->127.0.0.1:53: i/o timeout
Duration: 157.905076ms
edge
authservice
http
bgp
us1
|