Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.095555725s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 01:00:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.095586535s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.468943144s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:59:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.468973692s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.418739322s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:59:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.418760217s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.031436706s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:58:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.031470428s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.98298776s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:57:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.983023197s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.023313662s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:56:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.023342881s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.982545986s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:55:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.982568875s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.447876793s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:55:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.447892385s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.465828093s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:54:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.465855993s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.447718079s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:53:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.447740673s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.427183779s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:53:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.427207607s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.656120879s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:52:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.656258471s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.019934295s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:51:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.019975588s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.013535492s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:50:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.01355779s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.043155583s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:50:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.043184133s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.040943848s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:50:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.040968776s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.478817757s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:49:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.478839007s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.468402221s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:48:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.468427879s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.008816858s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:47:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.008844872s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.478749427s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:46:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.478773257s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.987214322s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:46:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.987291434s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.462317177s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:46:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.462343243s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.453634655s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:44:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.453734243s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.033024789s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:43:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.033046758s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.999320998s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:43:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.999346413s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.9942756s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:42:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.994300679s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.601726565s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:42:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.601750996s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.500986316s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:42:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.501025847s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.474860615s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:41:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.474936275s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.988633195s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:40:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.988658177s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.031956052s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:40:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.031982912s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.455120432s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:39:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.455190769s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.470490195s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:38:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.470523626s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.458907306s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:37:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.458946511s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.469372882s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:36:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.469387875s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.389948844s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:35:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.389973888s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.529564994s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:35:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.529595583s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.019120917s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:34:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.019156959s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.994876631s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:33:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.994892081s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.460034349s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:32:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.46005865s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.471886393s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:32:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.471913524s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.444308139s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:31:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.4443509s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.9807214s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:30:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.98074583s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.456773914s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:29:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.456799861s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.974709267s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:28:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.974800319s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.99668421s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:28:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.996721s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.424194857s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:27:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.424218225s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.49517336s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:27:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.495196005s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.454962288s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:26:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 2.454976866s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.994077426s trace: https://jaeger.dev.storj.io/trace/7789501b0117be9e FAIL (2025-12-04 00:26:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , upload=564822]: Uploading piece... Dec 4 00:24:55.490490971 (542h38m20.258174404s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490758150 (542h38m20.258441582s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.490867623 (542h38m20.25855105s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491164641 (542h38m20.258848057s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491275804 (542h38m20.258959233s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491509457 (542h38m20.259192874s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.491934674 (542h38m20.259618107s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492243019 (542h38m20.25992643s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492540538 (542h38m20.260223966s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.492833870 (542h38m20.260517295s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Uploading piece... Dec 4 00:24:55.909815998 (542h38m20.677499425s) [upload=564822]: Next returned nil segment Dec 4 00:24:55.909832035 (542h38m20.677515471s) [upload=564822]: Waiting for error group managing segments... Dec 4 00:24:56.086544111 (542h38m20.85422754s) [noise=true , address=81.171.14.70:4030 , piece_id=GKHZYL2VWVGRNQMZEJTMFS33MCR3VUKOV5NWERI6U7MMJKNNVNMQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.097321894 (542h38m20.865005319s) [noise=true , address=185.167.204.206:4070 , piece_id=2EN2H2EY5ELJKV2Q6AONP7W4F6O4ADBCMCRNQUZ3ECCTG6ZKUNJQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098346040 (542h38m20.866029469s) [noise=true , address=81.171.14.70:4029 , piece_id=KP4ATSCNLV7DK4JMHY35BBWS7XCIWFMKF5BVHK4NPI7XD7CF2FPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.098620616 (542h38m20.866304041s) [noise=true , address=185.167.204.206:4048 , piece_id=YOSDWDEUTPARPZW5LQECZ5DW774RG7EI7QNNTGWOJPH2P3ETYNHA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.099631498 (542h38m20.867314938s) [noise=true , address=185.167.204.205:4029 , piece_id=MAZCZWPUBGCBMO54FL7FKOAEWMCQHXQJW37LOJMH6HJD4ZA5DBCQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.102366357 (542h38m20.870049786s) [noise=true , address=185.167.204.205:4017 , piece_id=CMXUL4QT6GWDF7IW5MZCVOP36QJ3YYD64AO2GCOFVHOIUYD3AMBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106095516 (542h38m20.873778943s) [noise=true , address=81.171.14.70:4035 , piece_id=TXFXWMHFCUKLLCO35UW4LLOGXOR645O7R7RINFMVGISIEHI27RLA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.106514180 (542h38m20.874197617s) [noise=true , address=185.167.204.205:4034 , piece_id=3LV6T744IXPCROH32W67XCIKZEVY3V2IMBFCZ3XYNJVWKTEQ4I5A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.107962195 (542h38m20.875645622s) [noise=true , address=185.167.204.205:4011 , piece_id=OSEOGUZKP53P2XOQNECWKNYAP6Q23CKDAJTHQK2G3LFCLSSSXAWQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.108528413 (542h38m20.87621183s) [noise=true , address=185.167.204.205:4027 , piece_id=PUCNTCQA22YU5CV4JCVZ5A6D76RT25XRWVMPLDC6MM4JOZZ63WPA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112620299 (542h38m20.880303725s) [noise=true , address=185.167.204.205:4004 , piece_id=LCAVEBKXUZ6BBWVTU7JD4YWYPC377PJYQLJ6UDUUNYB2443QMWBA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.112746562 (542h38m20.880429978s) [noise=true , address=81.171.14.70:4039 , piece_id=YPGPA2FZHHZVWJIY45U467CMDACNF4D74USOCC6KKBYRY2T5CYIA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.113461832 (542h38m20.881145261s) [noise=true , address=185.167.204.205:4036 , piece_id=HOJWPP7RXPAYKGNPYMABOCRYIDQHKXQZOGM3T6QT6QLAUHXF34WQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117106183 (542h38m20.884789608s) [noise=true , address=185.167.204.206:4061 , piece_id=CUVQ4VTYLQJ4WJTIKX4WG5OEJY5FWDXJ7XZFHQW4GRHYBW7NJWVA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.117791379 (542h38m20.885474804s) [noise=true , address=89.149.201.147:4002 , piece_id=IMR4IBTHU3SHVRX22IHW4BKXUOYFUCOXVL2XR6QGZAVXBU3QMORQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.118638513 (542h38m20.886321941s) [noise=true , address=81.171.14.70:4046 , piece_id=LRTMLBZYXJAINJLAOS4W2J2NOVB3YKUQY5PPEJLP2LIY32OLHBEA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128203460 (542h38m20.895886887s) [noise=true , address=185.167.204.206:4038 , piece_id=YVUYGVOCQ4FTVC35VDKKWL22GLLHF4OJV54FVVBOUKNR26RI5U7A, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.128412152 (542h38m20.896095641s) [noise=true , address=185.167.204.205:4021 , piece_id=6LUIMZKAJES3DIFNUYBIFJIRHPR6DGFBE3NUBNDPJYNCBF3PN6RQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.141262846 (542h38m20.908946272s) [noise=true , address=185.167.204.206:4047 , piece_id=4KDLWARDCIDUNAIB27NMHU2G4QIKURNRHSYOCHQU33KNLXPLR2OA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142453398 (542h38m20.910136823s) [noise=true , address=81.171.14.70:4033 , piece_id=MLPOQYHXDLSPK75A7FPPQW42L3UW6RQMV3NTUBVSMJHI7ZRGDNVQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.142788894 (542h38m20.910472319s) [noise=true , address=185.167.204.205:4028 , piece_id=IFZIBABQFHFWXCUBVP7Y4VMIPWS2SKRULOMYKG4QQY3HZZ7IM2UQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.146866556 (542h38m20.914549981s) [noise=true , address=185.167.204.206:4039 , piece_id=BLX4WSWHF2AXKLZIGGQLAIBYXUWV3R32SAWE4BO6ZOA4XBF5GFCA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.148214588 (542h38m20.915898013s) [noise=true , address=89.149.201.147:4012 , piece_id=3URC2QMMDL7RCPEZ3NE4I5P3XUASXNZ7NAQG5WVEP3GZ5AYT2YKQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.169805920 (542h38m20.937489344s) [noise=true , address=185.167.204.205:4019 , piece_id=IXSVGUCON4YWUI7WRUF6FRLLMTFQ5QXT7THVMNWJDL3AZCABXRUQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.178232046 (542h38m20.945915488s) [noise=true , address=185.167.204.205:4033 , piece_id=6WVC4W2I2CBLMCUUM344FPMFWJ6JO2E3PSUEQVUHMKZF2C3CLDFQ, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181178264 (542h38m20.948861689s) [noise=true , address=81.171.14.70:4025 , piece_id=5ABHTETXY2OWDL5ZBIEFPLY2DJCZYYK4LJAITMG5AH4ZEKUNK2BA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: <nil> Dec 4 00:24:56.181195200 (542h38m20.948878625s) [seg_pos={0 0}, upload=564822]: Segment reached optimal threshold of 26 pieces. Dec 4 00:24:56.181337966 (542h38m20.949021396s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.181344755 (542h38m20.949028179s) [noise=true , address=81.171.14.70:4031 , piece_id=QTJ5PIXVPKBVX7Z7ACMFRXBN3UVJ3SR4A3SATE3SN3KMQJQT6UUA, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186066863 (542h38m20.953750294s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx): protocol: expected piece hash; context canceled; EOF Dec 4 00:24:56.186080458 (542h38m20.953763886s) [noise=true , address=81.171.14.70:4037 , piece_id=IGNVXMRHGZ2Z2AORACJYWTU3FOZ4ETPR5L5ZO5IZNI6GTK56A76Q, seg_pos={0 0}, upload=564822]: Long tail cancellation due to optimal threshold Dec 4 00:24:56.186099573 (542h38m20.953782984s) [seg_pos={0 0}, upload=564822]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 4 00:24:56.186171474 (542h38m20.953854899s) [upload=564822]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 4 00:24:56.186175975 (542h38m20.9538594s) [upload=564822]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 4 00:24:56.334112694 (542h38m21.101796121s) [upload=564822]: Done uploading segments... Dec 4 00:24:56.334133682 (542h38m21.101817107s) [upload=564822]: Upload finished. err: <nil> Duration: 1.994119207s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)