Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.435882948s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:44:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.435964805s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.491383604s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:43:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.491412906s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.470410177s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:42:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.47043082s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.010808434s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:42:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.010835261s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.022508694s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:41:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.02253396s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.020760271s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:41:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.020784834s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m34.849480371s trace: https://jaeger.dev.storj.io/trace/121ef6bdc56b5b14 FAIL (2025-12-12 18:40:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== e... Dec 12 18:38:24.656361040 (171h10m25.48406944s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.656894074 (171h10m25.484602476s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657468415 (171h10m25.485176815s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.657942993 (171h10m25.485651387s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658405274 (171h10m25.486113671s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.658858217 (171h10m25.486566611s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.659470070 (171h10m25.487178467s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.660242250 (171h10m25.487950632s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661033092 (171h10m25.488741492s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:24.661675227 (171h10m25.489383621s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Uploading piece... Dec 12 18:38:25.082629318 (171h10m25.910337702s) [upload=177932]: Next returned nil segment Dec 12 18:38:25.082659879 (171h10m25.9103683s) [upload=177932]: Waiting for error group managing segments... Dec 12 18:38:25.257629510 (171h10m26.085337889s) [noise=true , address=89.149.201.147:4022 , piece_id=WSMGTSI3QYBI72J6GEY53OLDSNX7D2WZ2FGSPWX4K6JJPZIHLAAA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259155587 (171h10m26.086863979s) [noise=true , address=185.167.204.205:4009 , piece_id=D6XMWFU7UCFGKCVLG672IJU77SSYSLLGR634YHQO4255W5ABUEAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259182970 (171h10m26.086891361s) [noise=true , address=185.167.204.206:4058 , piece_id=IBA44TFW6IWLTFJ6LPL3NCM76FS5VAS3QVJWC7SP7XKG256S6RVA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259757208 (171h10m26.0874656s) [noise=true , address=89.149.201.147:4013 , piece_id=FPVJK6TTXMAD5SK6AQQ3JDFHN7UV75IJZU5NTWVNLS6A5TV6S33A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.259863182 (171h10m26.087571565s) [noise=true , address=185.167.204.206:4064 , piece_id=7GOYXV3EI2U2I2FPPPUJCF6SOACQMWJHAPG74K5RCDJFHDWCG5KA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260376971 (171h10m26.088085364s) [noise=true , address=89.149.201.147:4016 , piece_id=YPF47QIHJAB5BYY2OAC5AR5A4QN5DMAQUWIP2TBLULCUXO3A7H5A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.260566696 (171h10m26.088275087s) [noise=true , address=185.167.204.205:4034 , piece_id=74QONXGC66LJOVZCXKZCERC5D5KIWYJBJ3UFPGUDH67XWPNFOJMQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261228688 (171h10m26.088937079s) [noise=true , address=81.171.14.70:4028 , piece_id=O47OPMJY5XTXH3DWJUIHYR5LOXBS72UH7U54RVQXIBX4GSE37O6Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.261798188 (171h10m26.08950658s) [noise=true , address=81.171.14.70:4026 , piece_id=AEBVEU6UZPOLNVACXJIPIBTZVHE5KR6GK6MIB6QZA6S2B6O5QQ3Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.263822981 (171h10m26.091531379s) [noise=true , address=185.167.204.205:4013 , piece_id=Z5FKCL7STNWSUALJ62XHNDCR4TZDSPKIAAK6BLD67NJFBNUZGCHA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.264515754 (171h10m26.092224148s) [noise=true , address=185.167.204.206:4057 , piece_id=MLJGCGRC42RRKNOYFJRS36CGGVVACRUL362LKXJN2LJZ5IEHAJOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.265814513 (171h10m26.093522904s) [noise=true , address=81.171.14.70:4027 , piece_id=WZXWWYREEJHEROLCDNDBGWAWYJ3IHKBQKFIHQNQHU3RATS4RMCAQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266773850 (171h10m26.094482245s) [noise=true , address=185.167.204.206:4065 , piece_id=XCCNLLZ3RB7CMCCY44X7AY2PRDV6GQ6MAKOA4ENPTZC4VKRZLUXA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.266803933 (171h10m26.094512331s) [noise=true , address=81.171.14.70:4034 , piece_id=V7C3IZOUPBM3GZL3GJKPHTD2KOF6JL2MPT5S2P357NIVR7H4PCSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.267356116 (171h10m26.095064508s) [noise=true , address=185.167.204.206:4045 , piece_id=MOXKNE3BENLFNNKKWFIM2INQNYDL2INCHBMVWLVEDFBKZIPJRQSQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276074216 (171h10m26.103782608s) [noise=true , address=185.167.204.205:4030 , piece_id=POYVA7U3HBMKO3DMICPGN65RANFH4VOKZHR3XSQ6FQEG22XBG3PQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.276173091 (171h10m26.103881486s) [noise=true , address=185.167.204.206:4069 , piece_id=X53BEIETMEGJLCZNAD4Z63MZQMQIO66SFL7VATBUX33S5JZYW4TQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.277901387 (171h10m26.105609782s) [noise=true , address=185.167.204.205:4026 , piece_id=OSR7ORBKCODOAF6L3SPYIJ5OIDG3DEQM6DYEB4PBK7HCJ5LNEVYQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.290398332 (171h10m26.118106726s) [noise=true , address=185.167.204.206:4066 , piece_id=VFAZPFUXB3KKEYHZMDNTHQNAFJY4WQNKITYUGCOJCAJZK5H2AOBQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.297761594 (171h10m26.125469985s) [noise=true , address=89.149.201.147:4014 , piece_id=R6RKJHENG2NOHXFKYELYXY7QCHXZQJOJYRRHEZH4LAH7QVPLWZ2A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.298594515 (171h10m26.12630291s) [noise=true , address=185.167.204.205:4025 , piece_id=V46Y75WDTONNO4AGU4CPRC25UN6YXMMZXVNGKYXZXFV2SHORBEVQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.309920095 (171h10m26.137628486s) [noise=true , address=89.149.201.147:4021 , piece_id=RT53GZWR2CFZLVQOSTGWK4OJWSJP2GMILHG5AICUNAFANCJGR57A, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314460373 (171h10m26.142168764s) [noise=true , address=185.167.204.205:4028 , piece_id=ND57MSA3AF4EQ27UQ3FF4XBLMLCYDYLLFTLYF6P4YJFUESZPOT5Q, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.314482220 (171h10m26.142190611s) [noise=true , address=81.171.14.70:4035 , piece_id=JO6FMTU5ENTTY7HRPUT7QW7FHGPECIBI7IXMVO5KHDFZMV5FUTPA, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.318567741 (171h10m26.146276133s) [noise=true , address=81.171.14.70:4032 , piece_id=QSKE3YQOHVHCWNBLFSVH6KLMCDHN5N77H55JVOA5BIKQ2CEFOOOQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340324110 (171h10m26.168032501s) [noise=true , address=185.167.204.205:4023 , piece_id=6IQJAV7QQFEMF273N3W3IWUNAFIXDQXHI4GNUJU26FVJ4HJD4QWQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: <nil> Dec 12 18:38:25.340345638 (171h10m26.168054029s) [seg_pos={0 0}, upload=177932]: Segment reached optimal threshold of 26 pieces. Dec 12 18:38:25.340583268 (171h10m26.168291671s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340598337 (171h10m26.168306725s) [noise=true , address=81.171.14.70:4045 , piece_id=OVJEVLA4AS55KRS6HEQHNHNZFI4T4OPZJZVPDSMCIQKBCO62NCTQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340922779 (171h10m26.168631179s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq): protocol: expected piece hash; context canceled; EOF Dec 12 18:38:25.340937639 (171h10m26.168646044s) [noise=true , address=81.171.14.70:4036 , piece_id=AY2L6VSUFJ5R6UGUJ64ULOKH2B2HWGLJ74UMRB23RM3KAJU4FGFQ, seg_pos={0 0}, upload=177932]: Long tail cancellation due to optimal threshold Dec 12 18:38:25.340967436 (171h10m26.168675814s) [seg_pos={0 0}, upload=177932]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 12 18:38:25.341133241 (171h10m26.168841641s) [upload=177932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 12 18:38:25.341142023 (171h10m26.168850424s) [upload=177932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 12 18:40:59.142680134 (171h12m59.970388531s) [upload=177932]: Done uploading segments... Dec 12 18:40:59.142773002 (171h12m59.970481405s) [upload=177932]: Upload finished. err: metaclient: context deadline exceeded Duration: 2m34.849518679s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 800.899063ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:05:21 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 800.96635ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 261.535156ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:04:33 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 261.564435ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 273.2948ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:03:57 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 273.31922ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 260.280091ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:03:34 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 260.308568ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.220876263s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 11:03:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.220900951s core uplink ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 284.343339ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:03:08 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 284.37091ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 5.084235991s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 11:02:48 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 5.084261959s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [.XXX........................................................] duration: 260.732685ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:02:36 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 260.757129ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [X.XXX.......................................................] duration: 280.845359ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:02:13 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 280.873729ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 4.383047187s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 11:02:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.383143765s core uplink ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 2 out of 60 is failed (threshold=6) [.XX.........................................................] duration: 282.465879ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:02:00 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 282.491515ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [X.XX........................................................] duration: 281.085901ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:01:43 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 281.110785ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [XX.XXX......................................................] duration: 263.954973ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:01:41 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 263.98315ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [.X.XX.......................................................] duration: 272.476553ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:01:23 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 272.502049ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [XXX.XXX.....................................................] duration: 284.609654ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 11:01:06 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 284.637006ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 4.397518397s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 11:00:59 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.397544012s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 3 out of 60 is failed (threshold=3) [X..XX.......................................................] duration: 4.564398307s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 11:00:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.564425405s core uplink ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [X.X.XX......................................................] duration: 306.607944ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:00:27 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 306.639987ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [.X.X.XX.....................................................] duration: 307.174738ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 11:00:12 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 307.199889ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 4 out of 60 is failed (threshold=3) [XX..XX......................................................] duration: 5.264504604s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 11:00:07 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 5.264607937s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [XXXX.XXX....................................................] duration: 285.621032ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:59:57 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 285.648208ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [..X.X.XX....................................................] duration: 277.874205ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 10:59:54 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 277.902474ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 5 out of 60 is failed (threshold=3) [XXX..XX.....................................................] duration: 4.349880541s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 10:59:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.34990818s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 6 out of 60 is failed (threshold=3) [XXXX..XX....................................................] duration: 4.708953665s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 10:59:22 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.708982698s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.989823521s trace: https://jaeger.dev.storj.io/trace/1a2c14f92a1c1a3a FAIL (2025-12-12 10:59:17 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 1.989861542s core uplink ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [...X.X.XX...................................................] duration: 281.403548ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 10:59:06 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 281.492844ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.016551085s trace: https://jaeger.dev.storj.io/trace/1a2c14f92a1c1a3a FAIL (2025-12-12 10:59:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 2.016590073s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.XXXX.XXX...................................................] duration: 803.858911ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:58:58 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 803.885001ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [..XXXX.XXX..................................................] duration: 291.695237ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:58:31 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 291.72038ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 2.028793056s trace: https://jaeger.dev.storj.io/trace/1a2c14f92a1c1a3a FAIL (2025-12-12 10:58:22 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 2.028814253s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.XXXX..XX...................................................] duration: 4.313887291s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 10:58:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.313912703s core uplink ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [....X.X.XX..................................................] duration: 815.867584ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 10:58:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 815.892852ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [...XXXX.XXX.................................................] duration: 749.124722ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:58:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 749.149303ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..XXXX..XX..................................................] duration: 5.037160266s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 10:57:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 5.037190204s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [....XXXX.XXX................................................] duration: 258.992612ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:57:34 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 259.032493ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 3 out of 60 is failed (threshold=3) [XX.X........................................................] duration: 1.983925614s trace: https://jaeger.dev.storj.io/trace/1a2c14f92a1c1a3a FAIL (2025-12-12 10:57:14 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 1.983949317s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...XXXX..XX.................................................] duration: 4.329848355s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 10:57:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.32987282s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [.....XXXX.XXX...............................................] duration: 259.170746ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:57:04 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 259.187456ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [.....X.X.XX.................................................] duration: 783.00172ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 10:56:56 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 783.027785ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 6 out of 60 is failed (threshold=3) [....XXXX..XX................................................] duration: 4.178622904s trace: https://jaeger.dev.storj.io/trace/1a63cab7b575aa32 FAIL (2025-12-12 10:56:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 4.178649593s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 4 out of 60 is failed (threshold=3) [XXX.X.......................................................] duration: 2.39474436s trace: https://jaeger.dev.storj.io/trace/1a2c14f92a1c1a3a FAIL (2025-12-12 10:56:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: rpc: tcp connector failed: rpc: dial tcp 34.2.157.232:7777: connect: connection refused Duration: 2.394770824s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [......XXXX.XXX..............................................] duration: 285.544591ms remote: "tcp:136.0.77.3:443" response headers: Accept-Ranges=bytes Content-Length=454 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1880707A645064B6 X-Xss-Protection=1; mode=block Date=Fri, 12 Dec 2025 10:19:00 GMT Vary=Origin X-Request-Id=Dm8E6J2n1JT target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5bde05e8f0838e16 FAIL (2025-12-12 10:56:10 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: bucket: metaclient: rpc: tcp connector failed: rpc: write tcp 79.127.219.42:55884->34.2.157.232:7777: write: connection refused)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1880707A645064B6</RequestId><HostId></HostId></Error>" Duration: 285.673007ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [......X.X.XX................................................] duration: 797.155976ms remote: "tcp:136.0.77.4:443" response headers: Access-Control-Allow-Headers=* Access-Control-Allow-Methods=GET, HEAD Access-Control-Allow-Origin=* X-Request-Id=AJT4uwHRG4v Date=Fri, 12 Dec 2025 10:18:52 GMT Content-Type=text/html; charset=utf-8 target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/1e7b71c9b5a29e22 FAIL (2025-12-12 10:55:57 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=a846e9f\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 797.179936ms edge linksharing bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)