Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X..............X............X....................] duration: 888.509146ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:51:50 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 888.549958ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 268.206643ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:51:43 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 268.221417ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......X......................X..............................] duration: 2.050027441s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:51:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.050055637s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X.....X......X......................] duration: 2.737779555s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:51:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.737849352s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......X......................X.............................] duration: 2.037824022s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:50:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.037849686s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 257.28922ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:50:50 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 257.312271ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.....X......X.....................] duration: 2.552300637s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:50:39 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.55232971s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X..............X............X...................] duration: 834.527049ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:50:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 834.554013ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........X......................X............................] duration: 2.57363932s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:50:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.57366734s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.....X......X....................] duration: 2.53532528s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:50:23 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.535360227s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration: 2.515979777s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:49:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.516009319s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 258.914375ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:49:52 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 258.937624ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X..............X............X..................] duration: 901.058247ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:49:47 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 901.08277ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.....X......X...................] duration: 2.549507599s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:49:44 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.549535834s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X.....X......X..................] duration: 2.655020994s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:49:24 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.655051469s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration: 2.506369695s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:48:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.506390129s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X..............X............X.................] duration: 851.598604ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:48:46 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 851.697157ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 256.892974ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:48:45 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 256.921311ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.....X......X.................] duration: 2.677739988s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:48:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.677767947s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 261.976342ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:48:21 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 262.076686ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X..............X............X................] duration: 823.736946ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:48:09 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 823.764767ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 259.229022ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:47:49 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 259.255688ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................X.........................] duration: 2.077633428s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:47:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.077656197s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.....X......X................] duration: 2.602959715s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:47:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.602988899s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [............X......................X........................] duration: 2.476735327s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:47:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.47676132s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X..............X............X...............] duration: 828.990227ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:47:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 829.017745ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 262.570348ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:47:03 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 262.599524ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.....X......X...............] duration: 2.468333346s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:46:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.468360776s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 259.504756ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:46:18 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 259.527123ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration: 2.024807353s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:46:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.024837738s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X..............X............X..............] duration: 797.895527ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:45:59 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 797.959466ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 261.168687ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:45:57 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 261.193528ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.....X......X..............] duration: 2.541597827s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:45:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.541626393s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................X......................] duration: 2.163735312s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:45:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.163762168s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X..............X............X.............] duration: 822.145741ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:45:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 822.199921ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 263.735173ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:45:04 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 263.891443ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X..............X............X............] duration: 860.634625ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:44:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 860.664536ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.....X......X.............] duration: 2.617927157s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:44:45 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.617987152s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 265.202675ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:44:42 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 265.227601ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................X.....................] duration: 2.099726217s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:44:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.099763529s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X..............X............X...........] duration: 803.080905ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:44:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 803.116706ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.....X......X............] duration: 2.64129983s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:43:46 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.641333419s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [................X......................X....................] duration: 2.486934871s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:43:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.48696514s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 260.223747ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:43:34 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 260.248718ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.....X......X...........] duration: 2.831020212s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:43:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.831051894s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 267.738863ms target: https://eu1.storj.io/login trace: https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1 FAIL (2025-12-23 15:43:18 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout Duration: 267.765553ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X..............X............X..........] duration: 855.493922ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:43:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 855.566873ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X..............X............X.........] duration: 881.437741ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 15:42:43 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 881.536018ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.....X......X..........] duration: 2.680716586s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 15:42:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.680876512s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................X...................] duration: 2.517084114s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 15:42:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.517113342s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)