Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 285.605969ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:47:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 285.631835ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 257.862893ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:46:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 257.886864ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 272.8213ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:45:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 272.843179ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 234.429536ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:45:19 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 234.454164ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 264.156694ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:44:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 264.180813ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 226.866094ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:43:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 226.892086ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 339.287874ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:42:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 339.304008ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 284.363459ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:41:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 284.390043ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 305.380688ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:40:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 305.432557ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 282.309219ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:39:56 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 282.350365ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 290.906566ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:39:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 290.938945ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 264.03963ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:39:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 264.131452ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 286.594593ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:38:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 286.623532ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 277.665423ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:37:50 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 277.689237ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 277.491456ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:37:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 277.591425ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 265.413166ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:35:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 265.446781ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 280.991345ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:35:16 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 281.017648ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 239.009559ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:34:22 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 239.030693ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 277.289325ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:33:59 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 277.33603ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 228.49329ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:33:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 228.516579ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 254.857972ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:32:23 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 254.885484ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 292.934946ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:31:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 292.956058ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 259.045709ms trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:30:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 259.072493ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00146928s trace: https://jaeger.dev.storj.io/trace/206405054ac0a519 FAIL (2025-11-21 07:30:34 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.001558502s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.055078137s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:10:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.055107805s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.481688131s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:10:16 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.481719911s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.014016592s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:09:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.014057857s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.430246449s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:09:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.430291096s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.41268057s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:08:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.412737667s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.426109465s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:07:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.426136341s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.437772832s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:06:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.437803706s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.141888086s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:06:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.141922298s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.098027707s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:05:53 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.098075769s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.619187974s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:04:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.619212784s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.490762296s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:03:47 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.490790669s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.416314328s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:03:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.416339566s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.457424445s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:02:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.457450763s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.465061703s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:01:01 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.465086964s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.011541664s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 18:00:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.011638386s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.435206313s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:59:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.435277621s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.477108965s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:59:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.477134544s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.486341821s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:57:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.4863587s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.463374426s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:57:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.463390946s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.145733117s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:56:46 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.145762174s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.994276431s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:56:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 1.994299782s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.521262168s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:55:01 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.521287832s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.000779534s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:54:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.000803644s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.487661647s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:53:36 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.487688783s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.485715013s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:53:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.485739625s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.465305383s trace: https://jaeger.dev.storj.io/trace/2978a773c720f2e4 FAIL (2025-11-20 17:52:18 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== load=232637]: Uploading piece... Nov 20 17:25:10.582877896 (223h38m35.350561328s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.584580409 (223h38m35.352263843s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.586378791 (223h38m35.354062219s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.588641711 (223h38m35.356325142s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.591403897 (223h38m35.359087325s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.593348617 (223h38m35.361032051s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.595567737 (223h38m35.363251162s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.597504768 (223h38m35.365188202s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.599544427 (223h38m35.367227861s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.600434395 (223h38m35.36811783s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Uploading piece... Nov 20 17:25:10.992513100 (223h38m35.760196525s) [upload=232637]: Next returned nil segment Nov 20 17:25:10.992541848 (223h38m35.760225277s) [upload=232637]: Waiting for error group managing segments... Nov 20 17:25:11.164544942 (223h38m35.932228366s) [noise=true , address=89.149.201.147:4022 , piece_id=4NQ4J3UJAABVO3SFMRORPXBTUGYXZMJNUWWTAKFIH3ZD5EVF3UXQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.172767990 (223h38m35.940451418s) [noise=true , address=81.171.14.70:4031 , piece_id=SHBKH5K4C7T7D7XMAAD6FDA36VCEJXQILDGEVNJZLTMD6EXLBL5A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182086404 (223h38m35.949769833s) [noise=true , address=185.167.204.205:4015 , piece_id=ZC3TZGH2N7NHRNMFGG2SVOS5UGTD4CY4OCLCQL2EEIN6RHEMQKIQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.182810476 (223h38m35.950493902s) [noise=true , address=81.171.14.70:4043 , piece_id=6474UQDNSX4UVDXJWZKSDBB5T47HGTYJZMJNTFK3PEQBR2KAY7RA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.183742078 (223h38m35.951425504s) [noise=true , address=185.167.204.206:4053 , piece_id=AIF5XPKJPTGUA7ENKUUTPPOKQCECEKQPPGEMAUOT5QAISCVMO22Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.184529255 (223h38m35.952212684s) [noise=true , address=81.171.14.70:4044 , piece_id=RICD4ZMMWVGLS6UTFKKZFUNKE2LI35QQ6VF4FYRMLDUMQDOQCCXA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.185123500 (223h38m35.952806926s) [noise=true , address=185.167.204.206:4066 , piece_id=H52XDJBLWKNNCE25VSBRNUH6BMW3JPBOFGQSEKF4CI3HBKCQSJZQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.186964052 (223h38m35.954647478s) [noise=true , address=185.167.204.205:4028 , piece_id=FVBJ6WVHKSN43OVNMH66KPBREGS2EWGD2EWCVJQX2WVMI27MPC7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.191410051 (223h38m35.959093477s) [noise=true , address=185.167.204.206:4054 , piece_id=LCBZUECG7VIQOE3X4VT6AT4HEQEEOTHEFBPSRXG7NUJC4PCGQ72Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.194616300 (223h38m35.962299725s) [noise=true , address=89.149.201.147:4001 , piece_id=7YTUOPW4BA4KDNJAXDHNUENBDIXNGZZW6576XQD5D3ISQXKBTYTQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.195124666 (223h38m35.962808091s) [noise=true , address=81.171.14.70:4027 , piece_id=OOS4I4CDV2TN42MWMHZBRCQWXGYXLHJTTUONDMTAHSQJKKPROYJA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.196224298 (223h38m35.963907724s) [noise=true , address=89.149.201.147:4005 , piece_id=U64XSFTL2TDVWNNOUQ6ULUGBPNU5XGQ6SI3HU7ZP6PPLZ7PZVRQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.198703124 (223h38m35.966386601s) [noise=true , address=185.167.204.206:4047 , piece_id=YZFK5OW7TWWIJ6FLA2XMAU3YURPKT2U5FGZYH6YLRNHUUDIV5N7A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.201965022 (223h38m35.969648447s) [noise=true , address=185.167.204.205:4034 , piece_id=MPKSGXYASP3YGAXWHL4PLGA7PJX56ELPS6NPJQIKLQN3GOYAUFDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.202483607 (223h38m35.970167033s) [noise=true , address=185.167.204.205:4002 , piece_id=27KMJOJSSJTIHEO5ZKY66GIG66P5QAESU4HHHLTI6KV2WZCFRWYQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.211202242 (223h38m35.978885672s) [noise=true , address=185.167.204.205:4036 , piece_id=LZSPRFBBIJPCW3IWHNW3SNKX4YTW7RCXTOOLE5SBGR2Z4WJHVCZA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.216399102 (223h38m35.984082529s) [noise=true , address=185.167.204.206:4046 , piece_id=VY3VEVR5VIHEH3MWJKDYS2UM62EP7ELZU3JI346NDESEORJIPZDQ, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.226445839 (223h38m35.994129265s) [noise=true , address=185.167.204.205:4026 , piece_id=YVFA5OFDVPAN3Q7GP7NIO6MC2N47G2MEWLJ7RVJEIP7UBHBYD5NA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240411560 (223h38m36.008094989s) [noise=true , address=185.167.204.206:4065 , piece_id=UHVHSM2N5H73YGCYEJ26JWO6IZZ76JTTYWM5ZZZZ2HMERRK7VDWA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.240958840 (223h38m36.008642266s) [noise=true , address=81.171.14.70:4047 , piece_id=D46YVEDXW2RT6OUYO73PHKREJF55SOCRWX6AMJ6RUWUC7G67426A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.241565965 (223h38m36.009249392s) [noise=true , address=81.171.14.70:4036 , piece_id=RNDJKD3UBSBBCUSY6AMAJ46JA4FPSOOQMWP247A3CGPMMTZXWQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242175176 (223h38m36.009858606s) [noise=true , address=81.171.14.70:4028 , piece_id=HEZAKOJDOQEBIFDRGYIXSCUWLPKUBTA6MRKQPR6665ZQXEPVIGQA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.242769247 (223h38m36.010452683s) [noise=true , address=81.171.14.70:4030 , piece_id=QAOOJJY2QL6NZQ3DN4NG5MNQCLPFBEZ73BJ4ESWPHMMHFJZV3I6Q, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.243245042 (223h38m36.010928472s) [noise=true , address=81.171.14.70:4029 , piece_id=XJF5EGWPXCL3PXV6WXEL46JAHMHZQGGR4AU5IOUNQLBG4C3BGQUA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.247956007 (223h38m36.015639437s) [noise=true , address=81.171.14.70:4048 , piece_id=KUYGLZGDWTEMEG637NPTQCKAEOAU42SCT4QKIGTAFTIVTUTMUV6A, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251384119 (223h38m36.019067547s) [noise=true , address=81.171.14.70:4025 , piece_id=EZNZI3X3CQI5B6ZMKVZABPZ5IZHVVS722EXVLWRHEF625CZFGORA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: <nil> Nov 20 17:25:11.251410363 (223h38m36.019093791s) [seg_pos={0 0}, upload=232637]: Segment reached optimal threshold of 26 pieces. Nov 20 17:25:11.251626678 (223h38m36.019310112s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Ku7o12bSmJ1YR3dGetGFcWqs1wJEh53Zkg3H7ELJrt4w1hkua): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.251642292 (223h38m36.019325718s) [noise=true , address=89.149.201.147:4018 , piece_id=EF6O3MQ6T6Y6SZLNBTHJGH4U52JOUUIT5FJSRBBZB3R3XRH7MDKA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252013645 (223h38m36.019697078s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15im1ewAFZd3JR1JxHcRxcrSkGaM7VwporX63EoYSfPmmj5ZzB): protocol: expected piece hash; context canceled; EOF Nov 20 17:25:11.252022652 (223h38m36.019706079s) [noise=true , address=81.171.14.70:4038 , piece_id=GCUUKZQY36F6XWCXJGHP6SSK5OKAH47HLPNBC76GVNNQID4DVLDA, seg_pos={0 0}, upload=232637]: Long tail cancellation due to optimal threshold Nov 20 17:25:11.252045137 (223h38m36.019728563s) [seg_pos={0 0}, upload=232637]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Nov 20 17:25:11.252321599 (223h38m36.020005025s) [upload=232637]: Flush batch item: pb.BatchRequestItem_SegmentCommit Nov 20 17:25:11.252330210 (223h38m36.020013635s) [upload=232637]: Flush batch item: pb.BatchRequestItem_ObjectCommit Nov 20 17:25:11.439953049 (223h38m36.207636477s) [upload=232637]: Done uploading segments... Nov 20 17:25:11.439975748 (223h38m36.207659185s) [upload=232637]: Upload finished. err: <nil> Duration: 2.465330605s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)