Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.....X......X...........] duration: 2.831020212s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:43:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.831051894s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 267.738863ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:43:18 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 267.765553ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..............X............X..........] duration: 855.493922ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:43:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 855.566873ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X..............X............X.........] duration: 881.437741ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:42:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 881.536018ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.....X......X..........] duration: 2.680716586s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:42:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.680876512s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................X...................] duration: 2.517084114s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:42:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.517113342s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.....X......X.........] duration: 25.474197488s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:42:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 25.474227435s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..............X............X........] duration: 18.785359834s trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:42:26 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 18.785386884s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 11.233959166s target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:42:26 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 11.233977052s core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................X..................] duration: 2.646113107s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:41:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.646133603s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.....X......X........] duration: 2.607389624s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:41:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.607417381s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X..............X............X.......] duration: 836.403917ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:41:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 836.436492ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 270.317005ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:41:08 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 270.343531ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................X.................] duration: 2.086997663s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:40:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.087022513s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.....X......X.......] duration: 2.607364202s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:40:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.60739071s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 259.907761ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:40:29 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 259.934496ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..............X............X......] duration: 850.088148ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:40:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 850.126921ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................X................] duration: 2.149048559s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:39:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.149072007s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..............X............X.....] duration: 908.982078ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:39:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 909.010117ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.....X......X......] duration: 2.540562223s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:39:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.540586055s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration: 2.576028096s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:39:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.576054325s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 257.005426ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:39:17 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 257.029492ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......................X......................X..............] duration: 2.485024755s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:38:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.485057534s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X.....X......X.....] duration: 2.711979119s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:38:45 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.712004134s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..............X............X....] duration: 869.806754ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:38:44 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 869.826283ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 257.993058ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:38:39 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 258.034338ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 257.712678ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:38:12 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 257.733638ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration: 2.472360991s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:38:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.472388608s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 260.930124ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:37:51 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 260.958198ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X.....X......X....] duration: 2.668409732s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:37:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.668440366s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X..............X............X...] duration: 792.336996ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:37:34 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 792.361819ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........................X......................X............] duration: 2.502225595s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:37:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.502259941s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..............X............X..] duration: 817.903689ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:36:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 817.936149ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X.....X......X...] duration: 3.167021454s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:36:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.167045302s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration: 2.078180707s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:36:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.078203996s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 266.5744ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:36:43 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 266.600512ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................................X.....X......X..] duration: 2.634308166s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:36:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.634335258s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration: 2.066790215s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:36:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.066821872s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration: 45.442938134s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:36:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 45.442979037s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..............X............X.] duration: 891.302565ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:36:04 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 891.327271ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 256.484107ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:35:58 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 256.568085ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X.....X......X.] duration: 23.482066617s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:35:47 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 23.482085716s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..............X............X] duration: 30.001027235s trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:35:45 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001050403s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X.....X......X] duration: 30.001070863s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:35:23 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 30.001090066s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 9.551769626s target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:34:59 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 9.551793687s core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [............................X......................X........] duration: 2.528178272s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:34:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.528205011s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 256.095993ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:34:15 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 256.122827ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.....X......] duration: 2.632972843s trace: https://jaeger.dev.storj.io/trace/a5ae6135be9170 FAIL (2025-12-23 15:34:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.633000824s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.............................X......................X.......] duration: 2.542788513s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:34:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.542880288s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X..............X............] duration: 872.629872ms trace: https://jaeger.dev.storj.io/trace/4115cae1c19ca6ae FAIL (2025-12-23 15:34:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 872.667933ms core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)