Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 566.06364ms trace: https://jaeger.dev.storj.io/trace/2ff3cb61697ef4b6 FAIL (2025-12-02 18:02:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1 (512h12m6.565207247s) [upload=533150]: Starting upload Dec 2 17:58:41.797600373 (512h12m6.565283807s) [upload=533150]: Done starting upload Dec 2 17:58:41.797703493 (512h12m6.565386907s) [upload=533150]: Uploading segments... Dec 2 17:58:41.797922579 (512h12m6.565606005s) [upload=533150]: Got next segment. Inline: false Dec 2 17:58:41.797975464 (512h12m6.56565889s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:41.797980961 (512h12m6.565664386s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 2 17:58:45.826641704 (512h12m10.594325119s) [seg_pos={0 0}, upload=533150]: Begin upload segment... Dec 2 17:58:45.826704608 (512h12m10.594388034s) [seg_pos={0 0}, upload=533150]: Done begin upload segment. Dec 2 17:58:45.826736929 (512h12m10.594420354s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827113477 (512h12m10.594796905s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827790378 (512h12m10.595473806s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828185978 (512h12m10.595869406s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828333113 (512h12m10.596016544s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828681485 (512h12m10.596364914s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828853063 (512h12m10.596536492s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829056243 (512h12m10.596739671s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829243823 (512h12m10.596927248s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829468022 (512h12m10.597151447s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829620763 (512h12m10.597304195s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829919326 (512h12m10.597602755s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830074947 (512h12m10.597758373s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830364126 (512h12m10.598047551s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830427732 (512h12m10.598111161s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830818895 (512h12m10.59850232s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.929763669 (512h12m10.697447094s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.929826388 (512h12m10.697509814s) [upload=533150]: Next returned nil segment Dec 2 17:58:45.929841528 (512h12m10.69752496s) [upload=533150]: Waiting for error group managing segments... Dec 2 17:58:45.931514752 (512h12m10.699198177s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932024553 (512h12m10.699707982s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932805477 (512h12m10.700488914s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933099890 (512h12m10.700783316s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933627663 (512h12m10.701311099s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935225037 (512h12m10.702908483s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935668414 (512h12m10.703351848s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936585494 (512h12m10.704268924s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936992930 (512h12m10.704676359s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.938169624 (512h12m10.70585305s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.939839291 (512h12m10.707522721s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941144675 (512h12m10.708828104s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941166602 (512h12m10.708850037s) [seg_pos={0 0}, upload=533150]: Segment reached optimal threshold of 13 pieces. Dec 2 17:58:45.941420693 (512h12m10.70910413s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection Dec 2 17:58:45.941433615 (512h12m10.709117052s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941790383 (512h12m10.709473818s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.941800244 (512h12m10.709483679s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941993661 (512h12m10.709677095s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bUyv2E7SXv5BCBjxbjHp99e4dKkuEwZpNv9zbFqddhD11CTq8): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.942004595 (512h12m10.709688033s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.942036759 (512h12m10.709720188s) [seg_pos={0 0}, upload=533150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 2 17:58:45.942132787 (512h12m10.709816219s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 2 17:58:45.942138898 (512h12m10.709822327s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:59:18.459127944 (512h12m43.226811375s) [upload=533150]: Done uploading segments... Dec 2 17:59:18.459220103 (512h12m43.226903534s) [upload=533150]: Upload finished. err: metaclient: context deadline exceeded Duration: 566.095111ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.08162884s trace: https://jaeger.dev.storj.io/trace/744490adeb12ced5 FAIL (2025-12-02 18:02:32 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.081722152s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 477.871273ms trace: https://jaeger.dev.storj.io/trace/2ff3cb61697ef4b6 FAIL (2025-12-02 18:02:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1 (512h12m6.565207247s) [upload=533150]: Starting upload Dec 2 17:58:41.797600373 (512h12m6.565283807s) [upload=533150]: Done starting upload Dec 2 17:58:41.797703493 (512h12m6.565386907s) [upload=533150]: Uploading segments... Dec 2 17:58:41.797922579 (512h12m6.565606005s) [upload=533150]: Got next segment. Inline: false Dec 2 17:58:41.797975464 (512h12m6.56565889s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:41.797980961 (512h12m6.565664386s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 2 17:58:45.826641704 (512h12m10.594325119s) [seg_pos={0 0}, upload=533150]: Begin upload segment... Dec 2 17:58:45.826704608 (512h12m10.594388034s) [seg_pos={0 0}, upload=533150]: Done begin upload segment. Dec 2 17:58:45.826736929 (512h12m10.594420354s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827113477 (512h12m10.594796905s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827790378 (512h12m10.595473806s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828185978 (512h12m10.595869406s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828333113 (512h12m10.596016544s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828681485 (512h12m10.596364914s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828853063 (512h12m10.596536492s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829056243 (512h12m10.596739671s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829243823 (512h12m10.596927248s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829468022 (512h12m10.597151447s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829620763 (512h12m10.597304195s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829919326 (512h12m10.597602755s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830074947 (512h12m10.597758373s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830364126 (512h12m10.598047551s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830427732 (512h12m10.598111161s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830818895 (512h12m10.59850232s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.929763669 (512h12m10.697447094s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.929826388 (512h12m10.697509814s) [upload=533150]: Next returned nil segment Dec 2 17:58:45.929841528 (512h12m10.69752496s) [upload=533150]: Waiting for error group managing segments... Dec 2 17:58:45.931514752 (512h12m10.699198177s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932024553 (512h12m10.699707982s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932805477 (512h12m10.700488914s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933099890 (512h12m10.700783316s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933627663 (512h12m10.701311099s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935225037 (512h12m10.702908483s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935668414 (512h12m10.703351848s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936585494 (512h12m10.704268924s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936992930 (512h12m10.704676359s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.938169624 (512h12m10.70585305s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.939839291 (512h12m10.707522721s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941144675 (512h12m10.708828104s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941166602 (512h12m10.708850037s) [seg_pos={0 0}, upload=533150]: Segment reached optimal threshold of 13 pieces. Dec 2 17:58:45.941420693 (512h12m10.70910413s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection Dec 2 17:58:45.941433615 (512h12m10.709117052s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941790383 (512h12m10.709473818s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.941800244 (512h12m10.709483679s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941993661 (512h12m10.709677095s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bUyv2E7SXv5BCBjxbjHp99e4dKkuEwZpNv9zbFqddhD11CTq8): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.942004595 (512h12m10.709688033s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.942036759 (512h12m10.709720188s) [seg_pos={0 0}, upload=533150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 2 17:58:45.942132787 (512h12m10.709816219s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 2 17:58:45.942138898 (512h12m10.709822327s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:59:18.459127944 (512h12m43.226811375s) [upload=533150]: Done uploading segments... Dec 2 17:59:18.459220103 (512h12m43.226903534s) [upload=533150]: Upload finished. err: metaclient: context deadline exceeded Duration: 477.899741ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 378.25745ms trace: https://jaeger.dev.storj.io/trace/6e74a775ed8fdecd FAIL (2025-12-02 18:02:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 2 17:58:29.492296357 (512h11m54.259979784s) [upload=533148]: Starting upload Dec 2 17:58:29.492428778 (512h11m54.260112196s) [upload=533148]: Done starting upload Dec 2 17:58:29.493319189 (512h11m54.2610026s) [upload=533148]: Uploading segments... Dec 2 17:58:29.493401893 (512h11m54.261085318s) [upload=533148]: Got next segment. Inline: true Dec 2 17:58:29.493408011 (512h11m54.261091436s) [upload=533148]: Waiting for error group managing segments... Dec 2 17:58:29.493462867 (512h11m54.261146278s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:29.493468588 (512h11m54.261152015s) [upload=533148]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 2 17:58:29.493473609 (512h11m54.261157044s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:58:29.552401870 (512h11m54.320085306s) [upload=533148]: Done uploading segments... Dec 2 17:58:29.552428076 (512h11m54.320111505s) [upload=533148]: Upload finished. err: <nil> Duration:* 378.291653ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 427.216151ms trace: https://jaeger.dev.storj.io/trace/2ff3cb61697ef4b6 FAIL (2025-12-02 18:01:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1 (512h12m6.565207247s) [upload=533150]: Starting upload Dec 2 17:58:41.797600373 (512h12m6.565283807s) [upload=533150]: Done starting upload Dec 2 17:58:41.797703493 (512h12m6.565386907s) [upload=533150]: Uploading segments... Dec 2 17:58:41.797922579 (512h12m6.565606005s) [upload=533150]: Got next segment. Inline: false Dec 2 17:58:41.797975464 (512h12m6.56565889s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:41.797980961 (512h12m6.565664386s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 2 17:58:45.826641704 (512h12m10.594325119s) [seg_pos={0 0}, upload=533150]: Begin upload segment... Dec 2 17:58:45.826704608 (512h12m10.594388034s) [seg_pos={0 0}, upload=533150]: Done begin upload segment. Dec 2 17:58:45.826736929 (512h12m10.594420354s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827113477 (512h12m10.594796905s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827790378 (512h12m10.595473806s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828185978 (512h12m10.595869406s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828333113 (512h12m10.596016544s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828681485 (512h12m10.596364914s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828853063 (512h12m10.596536492s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829056243 (512h12m10.596739671s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829243823 (512h12m10.596927248s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829468022 (512h12m10.597151447s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829620763 (512h12m10.597304195s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829919326 (512h12m10.597602755s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830074947 (512h12m10.597758373s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830364126 (512h12m10.598047551s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830427732 (512h12m10.598111161s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830818895 (512h12m10.59850232s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.929763669 (512h12m10.697447094s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.929826388 (512h12m10.697509814s) [upload=533150]: Next returned nil segment Dec 2 17:58:45.929841528 (512h12m10.69752496s) [upload=533150]: Waiting for error group managing segments... Dec 2 17:58:45.931514752 (512h12m10.699198177s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932024553 (512h12m10.699707982s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932805477 (512h12m10.700488914s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933099890 (512h12m10.700783316s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933627663 (512h12m10.701311099s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935225037 (512h12m10.702908483s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935668414 (512h12m10.703351848s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936585494 (512h12m10.704268924s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936992930 (512h12m10.704676359s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.938169624 (512h12m10.70585305s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.939839291 (512h12m10.707522721s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941144675 (512h12m10.708828104s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941166602 (512h12m10.708850037s) [seg_pos={0 0}, upload=533150]: Segment reached optimal threshold of 13 pieces. Dec 2 17:58:45.941420693 (512h12m10.70910413s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection Dec 2 17:58:45.941433615 (512h12m10.709117052s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941790383 (512h12m10.709473818s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.941800244 (512h12m10.709483679s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941993661 (512h12m10.709677095s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bUyv2E7SXv5BCBjxbjHp99e4dKkuEwZpNv9zbFqddhD11CTq8): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.942004595 (512h12m10.709688033s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.942036759 (512h12m10.709720188s) [seg_pos={0 0}, upload=533150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 2 17:58:45.942132787 (512h12m10.709816219s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 2 17:58:45.942138898 (512h12m10.709822327s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:59:18.459127944 (512h12m43.226811375s) [upload=533150]: Done uploading segments... Dec 2 17:59:18.459220103 (512h12m43.226903534s) [upload=533150]: Upload finished. err: metaclient: context deadline exceeded Duration: 427.230104ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.975871086s trace: https://jaeger.dev.storj.io/trace/744490adeb12ced5 FAIL (2025-12-02 18:01:17 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 1.975897003s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 398.091433ms trace: https://jaeger.dev.storj.io/trace/6e74a775ed8fdecd FAIL (2025-12-02 18:00:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 2 17:58:29.492296357 (512h11m54.259979784s) [upload=533148]: Starting upload Dec 2 17:58:29.492428778 (512h11m54.260112196s) [upload=533148]: Done starting upload Dec 2 17:58:29.493319189 (512h11m54.2610026s) [upload=533148]: Uploading segments... Dec 2 17:58:29.493401893 (512h11m54.261085318s) [upload=533148]: Got next segment. Inline: true Dec 2 17:58:29.493408011 (512h11m54.261091436s) [upload=533148]: Waiting for error group managing segments... Dec 2 17:58:29.493462867 (512h11m54.261146278s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:29.493468588 (512h11m54.261152015s) [upload=533148]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 2 17:58:29.493473609 (512h11m54.261157044s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:58:29.552401870 (512h11m54.320085306s) [upload=533148]: Done uploading segments... Dec 2 17:58:29.552428076 (512h11m54.320111505s) [upload=533148]: Upload finished. err: <nil> Duration:* 398.117636ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 490.953272ms trace: https://jaeger.dev.storj.io/trace/2ff3cb61697ef4b6 FAIL (2025-12-02 18:00:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1 (512h12m6.565207247s) [upload=533150]: Starting upload Dec 2 17:58:41.797600373 (512h12m6.565283807s) [upload=533150]: Done starting upload Dec 2 17:58:41.797703493 (512h12m6.565386907s) [upload=533150]: Uploading segments... Dec 2 17:58:41.797922579 (512h12m6.565606005s) [upload=533150]: Got next segment. Inline: false Dec 2 17:58:41.797975464 (512h12m6.56565889s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:41.797980961 (512h12m6.565664386s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 2 17:58:45.826641704 (512h12m10.594325119s) [seg_pos={0 0}, upload=533150]: Begin upload segment... Dec 2 17:58:45.826704608 (512h12m10.594388034s) [seg_pos={0 0}, upload=533150]: Done begin upload segment. Dec 2 17:58:45.826736929 (512h12m10.594420354s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827113477 (512h12m10.594796905s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827790378 (512h12m10.595473806s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828185978 (512h12m10.595869406s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828333113 (512h12m10.596016544s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828681485 (512h12m10.596364914s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828853063 (512h12m10.596536492s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829056243 (512h12m10.596739671s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829243823 (512h12m10.596927248s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829468022 (512h12m10.597151447s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829620763 (512h12m10.597304195s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829919326 (512h12m10.597602755s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830074947 (512h12m10.597758373s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830364126 (512h12m10.598047551s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830427732 (512h12m10.598111161s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830818895 (512h12m10.59850232s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.929763669 (512h12m10.697447094s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.929826388 (512h12m10.697509814s) [upload=533150]: Next returned nil segment Dec 2 17:58:45.929841528 (512h12m10.69752496s) [upload=533150]: Waiting for error group managing segments... Dec 2 17:58:45.931514752 (512h12m10.699198177s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932024553 (512h12m10.699707982s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932805477 (512h12m10.700488914s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933099890 (512h12m10.700783316s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933627663 (512h12m10.701311099s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935225037 (512h12m10.702908483s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935668414 (512h12m10.703351848s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936585494 (512h12m10.704268924s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936992930 (512h12m10.704676359s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.938169624 (512h12m10.70585305s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.939839291 (512h12m10.707522721s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941144675 (512h12m10.708828104s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941166602 (512h12m10.708850037s) [seg_pos={0 0}, upload=533150]: Segment reached optimal threshold of 13 pieces. Dec 2 17:58:45.941420693 (512h12m10.70910413s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection Dec 2 17:58:45.941433615 (512h12m10.709117052s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941790383 (512h12m10.709473818s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.941800244 (512h12m10.709483679s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941993661 (512h12m10.709677095s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bUyv2E7SXv5BCBjxbjHp99e4dKkuEwZpNv9zbFqddhD11CTq8): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.942004595 (512h12m10.709688033s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.942036759 (512h12m10.709720188s) [seg_pos={0 0}, upload=533150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 2 17:58:45.942132787 (512h12m10.709816219s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 2 17:58:45.942138898 (512h12m10.709822327s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:59:18.459127944 (512h12m43.226811375s) [upload=533150]: Done uploading segments... Dec 2 17:59:18.459220103 (512h12m43.226903534s) [upload=533150]: Upload finished. err: metaclient: context deadline exceeded Duration: 490.977251ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 303.760235ms trace: https://jaeger.dev.storj.io/trace/6e74a775ed8fdecd FAIL (2025-12-02 18:00:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 2 17:58:29.492296357 (512h11m54.259979784s) [upload=533148]: Starting upload Dec 2 17:58:29.492428778 (512h11m54.260112196s) [upload=533148]: Done starting upload Dec 2 17:58:29.493319189 (512h11m54.2610026s) [upload=533148]: Uploading segments... Dec 2 17:58:29.493401893 (512h11m54.261085318s) [upload=533148]: Got next segment. Inline: true Dec 2 17:58:29.493408011 (512h11m54.261091436s) [upload=533148]: Waiting for error group managing segments... Dec 2 17:58:29.493462867 (512h11m54.261146278s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:29.493468588 (512h11m54.261152015s) [upload=533148]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 2 17:58:29.493473609 (512h11m54.261157044s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:58:29.552401870 (512h11m54.320085306s) [upload=533148]: Done uploading segments... Dec 2 17:58:29.552428076 (512h11m54.320111505s) [upload=533148]: Upload finished. err: <nil> Duration:* 303.789337ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.939108213s trace: https://jaeger.dev.storj.io/trace/744490adeb12ced5 FAIL (2025-12-02 18:00:11 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 1.939138303s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 392.693178ms trace: https://jaeger.dev.storj.io/trace/2ff3cb61697ef4b6 FAIL (2025-12-02 17:59:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1 (512h12m6.565207247s) [upload=533150]: Starting upload Dec 2 17:58:41.797600373 (512h12m6.565283807s) [upload=533150]: Done starting upload Dec 2 17:58:41.797703493 (512h12m6.565386907s) [upload=533150]: Uploading segments... Dec 2 17:58:41.797922579 (512h12m6.565606005s) [upload=533150]: Got next segment. Inline: false Dec 2 17:58:41.797975464 (512h12m6.56565889s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:41.797980961 (512h12m6.565664386s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 2 17:58:45.826641704 (512h12m10.594325119s) [seg_pos={0 0}, upload=533150]: Begin upload segment... Dec 2 17:58:45.826704608 (512h12m10.594388034s) [seg_pos={0 0}, upload=533150]: Done begin upload segment. Dec 2 17:58:45.826736929 (512h12m10.594420354s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827113477 (512h12m10.594796905s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827790378 (512h12m10.595473806s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828185978 (512h12m10.595869406s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828333113 (512h12m10.596016544s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828681485 (512h12m10.596364914s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828853063 (512h12m10.596536492s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829056243 (512h12m10.596739671s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829243823 (512h12m10.596927248s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829468022 (512h12m10.597151447s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829620763 (512h12m10.597304195s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829919326 (512h12m10.597602755s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830074947 (512h12m10.597758373s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830364126 (512h12m10.598047551s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830427732 (512h12m10.598111161s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830818895 (512h12m10.59850232s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.929763669 (512h12m10.697447094s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.929826388 (512h12m10.697509814s) [upload=533150]: Next returned nil segment Dec 2 17:58:45.929841528 (512h12m10.69752496s) [upload=533150]: Waiting for error group managing segments... Dec 2 17:58:45.931514752 (512h12m10.699198177s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932024553 (512h12m10.699707982s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932805477 (512h12m10.700488914s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933099890 (512h12m10.700783316s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933627663 (512h12m10.701311099s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935225037 (512h12m10.702908483s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935668414 (512h12m10.703351848s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936585494 (512h12m10.704268924s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936992930 (512h12m10.704676359s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.938169624 (512h12m10.70585305s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.939839291 (512h12m10.707522721s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941144675 (512h12m10.708828104s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941166602 (512h12m10.708850037s) [seg_pos={0 0}, upload=533150]: Segment reached optimal threshold of 13 pieces. Dec 2 17:58:45.941420693 (512h12m10.70910413s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection Dec 2 17:58:45.941433615 (512h12m10.709117052s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941790383 (512h12m10.709473818s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.941800244 (512h12m10.709483679s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941993661 (512h12m10.709677095s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bUyv2E7SXv5BCBjxbjHp99e4dKkuEwZpNv9zbFqddhD11CTq8): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.942004595 (512h12m10.709688033s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.942036759 (512h12m10.709720188s) [seg_pos={0 0}, upload=533150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 2 17:58:45.942132787 (512h12m10.709816219s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 2 17:58:45.942138898 (512h12m10.709822327s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:59:18.459127944 (512h12m43.226811375s) [upload=533150]: Done uploading segments... Dec 2 17:59:18.459220103 (512h12m43.226903534s) [upload=533150]: Upload finished. err: metaclient: context deadline exceeded Duration: 392.716667ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.820497495s trace: https://jaeger.dev.storj.io/trace/744490adeb12ced5 FAIL (2025-12-02 17:59:41 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 1.820526011s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 313.759859ms trace: https://jaeger.dev.storj.io/trace/6e74a775ed8fdecd FAIL (2025-12-02 17:59:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 2 17:58:29.492296357 (512h11m54.259979784s) [upload=533148]: Starting upload Dec 2 17:58:29.492428778 (512h11m54.260112196s) [upload=533148]: Done starting upload Dec 2 17:58:29.493319189 (512h11m54.2610026s) [upload=533148]: Uploading segments... Dec 2 17:58:29.493401893 (512h11m54.261085318s) [upload=533148]: Got next segment. Inline: true Dec 2 17:58:29.493408011 (512h11m54.261091436s) [upload=533148]: Waiting for error group managing segments... Dec 2 17:58:29.493462867 (512h11m54.261146278s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:29.493468588 (512h11m54.261152015s) [upload=533148]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 2 17:58:29.493473609 (512h11m54.261157044s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:58:29.552401870 (512h11m54.320085306s) [upload=533148]: Done uploading segments... Dec 2 17:58:29.552428076 (512h11m54.320111505s) [upload=533148]: Upload finished. err: <nil> Duration:* 313.795512ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 36.695613197s trace: https://jaeger.dev.storj.io/trace/2ff3cb61697ef4b6 FAIL (2025-12-02 17:59:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 1 (512h12m6.565207247s) [upload=533150]: Starting upload Dec 2 17:58:41.797600373 (512h12m6.565283807s) [upload=533150]: Done starting upload Dec 2 17:58:41.797703493 (512h12m6.565386907s) [upload=533150]: Uploading segments... Dec 2 17:58:41.797922579 (512h12m6.565606005s) [upload=533150]: Got next segment. Inline: false Dec 2 17:58:41.797975464 (512h12m6.56565889s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:41.797980961 (512h12m6.565664386s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 2 17:58:45.826641704 (512h12m10.594325119s) [seg_pos={0 0}, upload=533150]: Begin upload segment... Dec 2 17:58:45.826704608 (512h12m10.594388034s) [seg_pos={0 0}, upload=533150]: Done begin upload segment. Dec 2 17:58:45.826736929 (512h12m10.594420354s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827113477 (512h12m10.594796905s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.827790378 (512h12m10.595473806s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828185978 (512h12m10.595869406s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828333113 (512h12m10.596016544s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828681485 (512h12m10.596364914s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.828853063 (512h12m10.596536492s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829056243 (512h12m10.596739671s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829243823 (512h12m10.596927248s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829468022 (512h12m10.597151447s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829620763 (512h12m10.597304195s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.829919326 (512h12m10.597602755s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830074947 (512h12m10.597758373s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830364126 (512h12m10.598047551s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830427732 (512h12m10.598111161s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.830818895 (512h12m10.59850232s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Uploading piece... Dec 2 17:58:45.929763669 (512h12m10.697447094s) [noise=true , address=145.79.227.34:4906 , piece_id=NMV35C5H3Q53ZVHJPEQQDTQY4UB7NRYTFD5SC7N7ANYG7IQM2CPQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.929826388 (512h12m10.697509814s) [upload=533150]: Next returned nil segment Dec 2 17:58:45.929841528 (512h12m10.69752496s) [upload=533150]: Waiting for error group managing segments... Dec 2 17:58:45.931514752 (512h12m10.699198177s) [noise=true , address=145.79.227.17:4971 , piece_id=5YBOSDBLQ5WAYAQQ22YWNKXV2IR3UOHYTNM4RW4QYIK5QOJWRVZQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932024553 (512h12m10.699707982s) [noise=true , address=77.90.31.14:4663 , piece_id=VZFCAJEFATYWIST6CFZIYGE646HF2B43O6OBI7ARLYUFEC7253AA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.932805477 (512h12m10.700488914s) [noise=true , address=145.79.227.14:4837 , piece_id=BPGESEZORPQPUSXHWQEH6E6NT5L4IDNSAOX4L7UZPRBTXYITRCKA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933099890 (512h12m10.700783316s) [noise=true , address=77.90.31.11:4554 , piece_id=374VOUS3GHZVX64PSHY53DP426UBOS6UAHWHK6S4GMNGAPMFHN2A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.933627663 (512h12m10.701311099s) [noise=true , address=145.79.227.9:4367 , piece_id=HERJJZCHIPKNVPFJVXNK3Y4KKT6UY64NLLKY7O3N6CQUJBCATWXA, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935225037 (512h12m10.702908483s) [noise=true , address=145.79.227.10:4401 , piece_id=QT7N453UNLOQVAPXNDMNH5S7FDP5SJBU6YTMTGTIPWMDA2CXP7QQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.935668414 (512h12m10.703351848s) [noise=true , address=145.79.227.33:4871 , piece_id=UUJBXXASIWHFJBADPBOTP6R2RHVM75BVJDYNM724VN6OGA3TB5IQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936585494 (512h12m10.704268924s) [noise=true , address=145.79.227.30:4761 , piece_id=HQ6YY6D6ULP5YRPAI3SPCDGOUI7O5BVHPSCOB44VISN3RK4KP52Q, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.936992930 (512h12m10.704676359s) [noise=true , address=145.79.227.38:4978 , piece_id=WX52RITMP6VKVJVDZAQ3LL6NH37CTXXSDW7NKSEKTMQKLXJ2YPAQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.938169624 (512h12m10.70585305s) [noise=true , address=145.79.227.15:4874 , piece_id=VMF6DLYNWVI6AFQGZPHC6ASKC7JULVPFJBAT7LFHA2JECWKTXRWQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.939839291 (512h12m10.707522721s) [noise=true , address=145.79.227.27:4689 , piece_id=SW6DMTAZP3DRBEU2VP2HL2Z6NTEH57GES7BG3AYNPWSGXIPQSR6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941144675 (512h12m10.708828104s) [noise=true , address=145.79.227.28:4727 , piece_id=YB5VUK64I33MEQQFLAZDQ7U25KCWFQLP2HARRB67BYYV76P26NNQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: <nil> Dec 2 17:58:45.941166602 (512h12m10.708850037s) [seg_pos={0 0}, upload=533150]: Segment reached optimal threshold of 13 pieces. Dec 2 17:58:45.941420693 (512h12m10.70910413s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:38284->77.90.31.16:4734: use of closed network connection Dec 2 17:58:45.941433615 (512h12m10.709117052s) [noise=true , address=77.90.31.16:4734 , piece_id=OLZ7LESLE7ZSSJECIWPRVPS4KAHLRKAIAQT7Q44A2ASHAOFERYMQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941790383 (512h12m10.709473818s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.941800244 (512h12m10.709483679s) [noise=true , address=77.90.31.18:4806 , piece_id=6ZY5B6G6UYZ6ROUZCEUFFQ2P2A42CULO4CNWPNEOS6T6XS7EDO6A, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.941993661 (512h12m10.709677095s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bUyv2E7SXv5BCBjxbjHp99e4dKkuEwZpNv9zbFqddhD11CTq8): protocol: expected piece hash; context canceled; EOF Dec 2 17:58:45.942004595 (512h12m10.709688033s) [noise=true , address=145.79.227.25:4618 , piece_id=XAWU77AM7JIBMX7BINPHJASZ63ZIBDLLN74D4GC53GWJLR6RH2DQ, seg_pos={0 0}, upload=533150]: Long tail cancellation due to optimal threshold Dec 2 17:58:45.942036759 (512h12m10.709720188s) [seg_pos={0 0}, upload=533150]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Dec 2 17:58:45.942132787 (512h12m10.709816219s) [upload=533150]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 2 17:58:45.942138898 (512h12m10.709822327s) [upload=533150]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:59:18.459127944 (512h12m43.226811375s) [upload=533150]: Done uploading segments... Dec 2 17:59:18.459220103 (512h12m43.226903534s) [upload=533150]: Upload finished. err: metaclient: context deadline exceeded Duration: 36.695644843s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.035649962s trace: https://jaeger.dev.storj.io/trace/744490adeb12ced5 FAIL (2025-12-02 17:59:10 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.035684786s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00169298s trace: https://jaeger.dev.storj.io/trace/744490adeb12ced5 FAIL (2025-12-02 17:59:00 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.001790212s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002009695s trace: https://jaeger.dev.storj.io/trace/6e74a775ed8fdecd FAIL (2025-12-02 17:58:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Dec 2 17:58:29.492296357 (512h11m54.259979784s) [upload=533148]: Starting upload Dec 2 17:58:29.492428778 (512h11m54.260112196s) [upload=533148]: Done starting upload Dec 2 17:58:29.493319189 (512h11m54.2610026s) [upload=533148]: Uploading segments... Dec 2 17:58:29.493401893 (512h11m54.261085318s) [upload=533148]: Got next segment. Inline: true Dec 2 17:58:29.493408011 (512h11m54.261091436s) [upload=533148]: Waiting for error group managing segments... Dec 2 17:58:29.493462867 (512h11m54.261146278s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 2 17:58:29.493468588 (512h11m54.261152015s) [upload=533148]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Dec 2 17:58:29.493473609 (512h11m54.261157044s) [upload=533148]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 2 17:58:29.552401870 (512h11m54.320085306s) [upload=533148]: Done uploading segments... Dec 2 17:58:29.552428076 (512h11m54.320111505s) [upload=533148]: Upload finished. err: <nil> Duration:* 30.002088773s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 124.714212ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:14:25 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 124.736404ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 109.916661ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:13:37 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 109.94321ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 105.549704ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:12:29 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 105.574922ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 109.516823ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:11:55 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 109.540289ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 130.448999ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:10:40 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 130.469798ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 99.002573ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:09:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 99.035517ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 111.027541ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:08:26 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 111.056861ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 110.683712ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:07:20 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 110.7005ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 116.637433ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:06:53 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 116.668964ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 109.478444ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:06:02 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 109.507134ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 101.003852ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:05:21 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 101.030837ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 106.395303ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:04:55 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 106.422634ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 107.293735ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:04:09 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 107.335064ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 108.58039ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:03:21 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 108.601627ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 114.691744ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:02:42 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 114.733244ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 138.491335ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:02:00 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 138.542508ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 111.849301ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:01:24 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 111.877747ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 153.762411ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 14:00:42 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 153.783675ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 109.075957ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:59:37 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 109.100757ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 110.077979ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:59:15 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 110.104054ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 112.439195ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:58:52 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 112.460582ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 112.449765ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:58:20 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 112.487576ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 107.139867ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:57:38 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 107.168934ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 111.422577ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:56:31 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 111.45325ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 103.935829ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:55:59 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 103.956738ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 112.36785ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:55:21 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 112.393796ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 111.049606ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:54:41 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 111.145111ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 116.685029ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:53:42 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 116.710677ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 122.097356ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:53:15 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 122.119994ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 119.191873ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:52:14 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 119.215515ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 112.770096ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:51:35 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 112.795266ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 110.843642ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:51:15 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 110.870104ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 111.155253ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace: https://jaeger.dev.storj.io/trace/a50c3e17aab974c FAIL (2025-12-02 13:50:02 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": context deadline exceeded Duration: 111.309933ms edge gateway vhost bgp eu1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)