Orbiter History

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..X..................] duration: 4.376386519s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:16:34 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.376413058s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 2.090719877s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:16:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.090747909s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.716458528s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:16:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.716479483s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..X.................] duration: 4.208315627s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:15:59 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.208342507s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 834.618182ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:15:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 834.65049ms core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 729.443885ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:15:45 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 729.470127ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 2.136760811s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:15:40 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.136791247s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 730.432642ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:15:15 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 730.446425ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 2.151420559s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:15:14 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.151453799s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..X................] duration: 4.399004457s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:15:04 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.39903933s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 841.789572ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:14:52 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 841.900954ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.825724743s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:14:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.825749333s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 2.136820483s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:14:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.136846027s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 737.254447ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:14:22 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 737.281175ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 810.654854ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:14:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 810.688267ms core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..X...............] duration: 4.275497664s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:14:06 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.275528983s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 2.133997646s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:14:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.134049888s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.730472566s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:13:55 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.730517043s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 850.596891ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:13:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 850.663157ms core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 2.039233767s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:13:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.039258108s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.472344176s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 16:13:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.472364188s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.670165138s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:13:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.670192356s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..X..............] duration: 4.321471373s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:13:09 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.321500616s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 705.217791ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:13:09 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 705.244525ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 852.516435ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:12:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 852.616805ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.669635478s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:12:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.669661973s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..X.............] duration: 4.548976594s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:12:26 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.54901383s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X......X....................................................] duration: 2.635025963s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:12:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.635054937s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 731.024629ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:12:16 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 731.06243ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.104671668s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 16:12:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.104765704s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 2.196793251s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:12:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.196824805s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 849.07549ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:11:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 849.101409ms core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 728.947718ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:11:55 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 728.971089ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.487486544s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 16:11:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.487501729s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X......X...................................................] duration: 2.555085065s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:11:44 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.555109841s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..X............] duration: 4.590265984s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:11:42 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.590289244s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 734.167864ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:11:39 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 734.231721ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 2.076240248s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:11:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.076267714s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.073044508s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 16:11:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.073079777s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 811.691707ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:10:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 811.737075ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X......X..................................................] duration: 2.555299798s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:10:46 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.555333752s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X..X...........] duration: 4.296000207s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:10:43 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.296028318s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.056087525s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 16:10:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.056117647s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [X............X..............................................] duration: 850.559523ms trace: https://jaeger.dev.storj.io/trace/67795d781c8f55f2 FAIL (2025-12-23 16:10:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 850.589866ms core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 700.548068ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:10:29 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 700.573355ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X..X..........] duration: 4.309870501s trace: https://jaeger.dev.storj.io/trace/516671bee2c28e70 FAIL (2025-12-23 16:10:13 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.309902842s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X......X.................................................] duration: 2.829344284s trace: https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c FAIL (2025-12-23 16:10:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.829374253s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 718.201205ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/202098c90d65b336 FAIL (2025-12-23 16:10:00 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 718.244108ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.020299355s trace: https://jaeger.dev.storj.io/trace/20ee6d11665285b1 FAIL (2025-12-23 16:09:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece... Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments... Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036 , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039 , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005 , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025 , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009 , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035 , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033 , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017 , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040 , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020 , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008 , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027 , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043 , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil> Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces. Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024 , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032 , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: pb.BatchRequestItem_SegmentCommit Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: pb.BatchRequestItem_ObjectCommit Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments... Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.020326552s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 2.373370075s trace: https://jaeger.dev.storj.io/trace/47e54c485a783966 FAIL (2025-12-23 16:09:52 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.373397406s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)