Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.055132922s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:22:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.055185707s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.147292509s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:21:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.147317682s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.043903013s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:20:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.04394277s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.050856035s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:19:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.050874084s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.349240647s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:18:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.34926502s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.503812202s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:17:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.503837031s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.020668579s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:17:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.020693371s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.504352914s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:16:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.504376477s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.007570358s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:15:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.007597334s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.051343644s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:15:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.05136822s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.035522367s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:14:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.03554883s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.084011059s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:13:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.084034268s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.529029846s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:12:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.529061873s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.465797328s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:12:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.465839085s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.055200737s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:11:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.055350086s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.019239489s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:10:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.019274125s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.438647862s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:10:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.438683344s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.408603861s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:09:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.408637271s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.46904299s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:08:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.469097243s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.455599859s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:07:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.455626031s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.44377792s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:06:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.4438097s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.010372786s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:06:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.010399301s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 1.985119647s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:06:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.985148042s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.042173071s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:05:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.042195886s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.07598752s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:04:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.076014953s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.046768002s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:03:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.046806612s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.485309244s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:02:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.48536826s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.503430401s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:01:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.503453582s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.994544848s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:00:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.994569084s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.064248515s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 19:00:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.064281805s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.427452026s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:58:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.427474519s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.561128768s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:58:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.561166497s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.046238477s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:57:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.046265445s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.448393122s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:56:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.448420562s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.486813035s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:56:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.487046829s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.012715083s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:55:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.012748208s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.468199514s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:54:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.468226916s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.484348834s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:53:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.484462095s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.456258586s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:52:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.456283839s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.028566006s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:52:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.028590013s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.485001074s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:51:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.485031011s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.426435618s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:50:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.426474035s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.999483992s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:49:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.999508429s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.514562989s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:49:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.514591924s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.047851748s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:48:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.047870604s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.538443756s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:48:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.538481694s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.053955258s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:47:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.053979701s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.743334705s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:46:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.743365205s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.051199118s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:45:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.051221873s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.490594457s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:45:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.490630676s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)