Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.760060742s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:05:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 6.760087216s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.13583685s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:04:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 6.135905542s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 7.841235201s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:02:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 7.841327111s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.607705202s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:02:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 5.607727818s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 9.769346137s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:01:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 9.769370587s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.005134616s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:00:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 4.005165873s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.180435476s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 01:00:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 6.180509316s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 10.51186822s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:59:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 10.511887141s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 3.272604806s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:57:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.272632487s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 3.419816328s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:57:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.419839684s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.968821819s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:56:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 2.9688515s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 9.022729315s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:56:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 9.022818016s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 3.57813126s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:55:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.578539536s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 3.995049192s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:53:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.99507588s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 3.131067656s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:52:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.131096163s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 3.046827952s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:52:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.046853609s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.600893662s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:51:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 5.600925447s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 3.371870831s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:51:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.371895839s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 11.892641623s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:50:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 11.892662954s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 10.032837685s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:49:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 10.03288121s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 7.427212454s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:49:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 7.427248023s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 3.911276402s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:48:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.911316499s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 3.492629939s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:47:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.492661604s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 4.092117516s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:46:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 4.092143314s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 11.501244264s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:46:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 11.501279892s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 3.537243346s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:45:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.537273492s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.416276716s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:45:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 6.41630696s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.487482024s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:44:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 6.4875032s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 3.436449615s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:43:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 3.4364695s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 24.210096317s trace: https://jaeger.dev.storj.io/trace/1ae48fde171f1e73 FAIL (2025-12-09 00:42:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: quiescence ======LOGS====== 431]: Uploading piece... Dec 9 00:42:18.349555508 (81h14m19.177263902s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.349915214 (81h14m19.177623605s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350255805 (81h14m19.177964202s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350420977 (81h14m19.178129371s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.350744803 (81h14m19.178453197s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351159312 (81h14m19.178867703s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351523348 (81h14m19.17923174s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351536441 (81h14m19.179244835s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.351898017 (81h14m19.179606411s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.352443120 (81h14m19.180151515s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Uploading piece... Dec 9 00:42:18.787967509 (81h14m19.6156759s) [upload=84431]: Next returned nil segment Dec 9 00:42:18.788012770 (81h14m19.615721163s) [upload=84431]: Waiting for error group managing segments... Dec 9 00:42:18.957843773 (81h14m19.785552172s) [noise=true , address=81.171.14.70:4025 , piece_id=WKCLO53IZOQJJBEWAOFWA6BVPZZGZ7BR2C2Y7WSC3TYRHNAHNVIQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.964776538 (81h14m19.79248493s) [noise=true , address=81.171.14.70:4030 , piece_id=UHQEPVT2EDFXBLAEXRXHTOJ4RX2TG62HZUWC7BSKPSC7XHLKFB4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:18.993346643 (81h14m19.821055025s) [noise=true , address=81.171.14.70:4036 , piece_id=25PA6KBT63FB5S6ITLFLYDAL4434TCCANMFKB245BE5QV7QQVTRQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.012142948 (81h14m19.839851351s) [noise=true , address=81.171.14.70:4041 , piece_id=2VQG2RNJDGSJXILJO3OJ4U7E7FPRFJPKILJTKFYOYDWBSVD2RFRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.022826121 (81h14m19.850534519s) [noise=true , address=81.171.14.70:4033 , piece_id=ARCKWP3MNFEPBMTXLVHZX4LFPGGTHONTSOASUNGCS5BQUXVJG4HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.063578853 (81h14m19.891287244s) [noise=true , address=89.149.201.147:4010 , piece_id=TLVJNVTD5BQWQTZQIWJYAWPXVCMT3IMEMOB7V7Q6ZNSN5626Z4CQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.342882228 (81h14m20.170590621s) [noise=true , address=89.149.201.147:4022 , piece_id=CO2G6Y7QHLUMGFRDVAV54RKKVAOR62VTXKTHW7WFDGWRCRQDGKXQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.375538173 (81h14m20.203246554s) [noise=true , address=185.167.204.206:4038 , piece_id=3VP7QJ2UMTISCSV76HZTV5XEQ7ENEHKFLUNP7JQX6VTM53W57ADA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.413795687 (81h14m20.241504094s) [noise=true , address=81.171.14.70:4031 , piece_id=2EZH3GEHB4DU6NVDAVXDSO34CAKP4JA6JNDIUOUUHIDN4ARTKNVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.447694798 (81h14m20.275403199s) [noise=true , address=185.167.204.206:4048 , piece_id=S4XZ7VAPSKHBDHRMS67GDZJWCOMAFLMGMEYJA3Y5SM5XHT7FYJRA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.458660706 (81h14m20.286369097s) [noise=true , address=81.171.14.70:4040 , piece_id=3T6KZGJPMGIUHAIVCGYE3L6MCORLWG5YJT22XVXSAVQ6VKQBWAXA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.459487553 (81h14m20.287195945s) [noise=true , address=185.167.204.205:4007 , piece_id=4NFS3Y4ZKSYDEDOMIQQ62CUSWKZPGP43NDIEBV2IT2ZVDJLD744A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.493534151 (81h14m20.321242543s) [noise=true , address=185.167.204.206:4070 , piece_id=B6BRUJUF3EQQXH7SZE4ZHLSTQNOLINCO7NCE6SJOT555XDOQER5Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.534850646 (81h14m20.362559037s) [noise=true , address=185.167.204.205:4033 , piece_id=RTPDKSUKCZW57ZMMLMVGSQUZPZKDYXOBDEZCJME4DVZZIRZ733UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.559286441 (81h14m20.386994832s) [noise=true , address=89.149.201.147:4015 , piece_id=VDRCP7KNVW3ZYE5SZ5SNMCAM7FHF4CFGLWRQEW5GCENB4RYP57UQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.596129224 (81h14m20.423837615s) [noise=true , address=89.149.201.147:4023 , piece_id=ROEJ5V7NXGCY67YDGAFKTWZJDHBADI3GW77VRW42FVLBMMBLXOQA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.651975496 (81h14m20.479683887s) [noise=true , address=185.167.204.206:4039 , piece_id=DPKTXVTDHTKY6VB3M3VT7FLOWIABR7VYA45LS7EJSPMCPZ6B26UA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.831424466 (81h14m20.659132857s) [noise=true , address=185.167.204.206:4058 , piece_id=DK5I65SFZWRLTIPH6FY3QGKLINPLIIYW7P4RXT47RAGZECHPMV4A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.835500067 (81h14m20.663208461s) [noise=true , address=185.167.204.205:4018 , piece_id=KVSE7SHZZNXSBZ6TJIMXKYBPKZGJHJJM6JYA6FCSYLXPUWX7N7GQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.859903205 (81h14m20.687611596s) [noise=true , address=185.167.204.206:4064 , piece_id=2L4P35K7UTAIV7PLEPABCIZSYOENQ37LA5VS6AMQNNBRMOVMLU3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:19.986818261 (81h14m20.814526659s) [noise=true , address=89.149.201.147:4004 , piece_id=JVKBZJ33GL3I6EAHVGZWROKXV6UHE4WENFABWMLQ7OTGMDL3ODEA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.393469827 (81h14m21.221178213s) [noise=true , address=89.149.201.147:4014 , piece_id=N5VVAVJKLHCMIT2LOFVLUZBF6TOKOVSI6O23JEOS6R6UVY45EX4Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.741878447 (81h14m21.569586842s) [noise=true , address=89.149.201.147:4024 , piece_id=2US4JMMMZPJ5FNIQMJHDTEENMI4KC5AXYWUP3XQA57Y3G3E2SI6A, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:20.840486734 (81h14m21.668195128s) [noise=true , address=185.167.204.206:4068 , piece_id=SRZHDHCECW7B67OZF2DOZVGN25XJC7BUT6AOJJUAQENB7OI5SVVA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.527454216 (81h14m22.355162608s) [noise=true , address=185.167.204.206:4053 , piece_id=FCMLI7FHQPRU4PZCMD4KNNUCGALNLJTWSAXO4CBESISOUG3VA2HQ, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633923496 (81h14m22.461631899s) [noise=true , address=185.167.204.206:4072 , piece_id=RQ4WVVOZV5J4PQE2EVMMN3CULDE4UB5G444X3S2IK3CJJIARRC3Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: <nil> Dec 9 00:42:21.633950916 (81h14m22.461659317s) [seg_pos={0 0}, upload=84431]: Segment reached optimal threshold of 26 pieces. Dec 9 00:42:21.634329611 (81h14m22.462038002s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF): protocol: expected piece hash; context canceled; EOF Dec 9 00:42:21.634342626 (81h14m22.462051023s) [noise=true , address=185.167.204.205:4003 , piece_id=GJNZ2CFCNEJH4ROMH4FL7ANYX5FOHFFMZDI2QYFKQMUWBN5LTK7Q, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634383757 (81h14m22.462092159s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ns5eXmL9FCPxzevdEpYg6HZEjHnE3ZRB6JRhY51hMMW2mEmUg): protocol: read tcp 159.223.143.39:44726->185.167.204.206:4066: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 00:42:21.634400552 (81h14m22.462108944s) [noise=true , address=185.167.204.206:4066 , piece_id=LMF5QLN5FSB6X2MIUTEK6PGN65MKZFKVEYQ36GDULJ7DDFQLBDOA, seg_pos={0 0}, upload=84431]: Long tail cancellation due to optimal threshold Dec 9 00:42:21.634423057 (81h14m22.462131435s) [seg_pos={0 0}, upload=84431]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 9 00:42:21.634528085 (81h14m22.462236483s) [upload=84431]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 9 00:42:21.634535147 (81h14m22.462243546s) [upload=84431]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 9 00:42:21.793166703 (81h14m22.620875098s) [upload=84431]: Done uploading segments... Dec 9 00:42:21.793210854 (81h14m22.620919248s) [upload=84431]: Upload finished. err: <nil> Duration: 24.210147909s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 751.844646ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:14:28 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 751.87374ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 743.862647ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:13:20 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 743.886678ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 727.793438ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:13:04 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 727.820883ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 731.354966ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:11:53 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 731.381791ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 856.796564ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:11:06 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 856.906309ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 855.059516ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:10:10 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 855.096491ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 853.267327ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:09:41 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 853.291108ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.974820422s remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:09:13 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 1.974865035s core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 704.307309ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:08:39 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 704.330501ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 857.352137ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:08:05 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 857.389906ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 704.441569ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:07:41 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 704.532754ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 733.452748ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:07:23 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 733.480827ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.983950976s remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:06:26 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 1.983979684s core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 747.204978ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:05:18 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 747.226017ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 728.622397ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:04:19 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 728.647922ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.73388347s remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:03:41 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 1.733966915s core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 705.310032ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:02:53 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 705.343554ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 728.591348ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:02:18 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 728.618623ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 713.520264ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:01:10 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 713.546386ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 887.983133ms remote: "tcp:34.2.157.232:443" target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3263ffdbd3f586e0 FAIL (2025-12-08 20:00:12 UTC) orbiter warning: Get "https://ap1.storj.io/login": EOF Duration: 888.037386ms core satellite ap1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)