Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 163650 reports (Page 17 of 3273)
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [...........X.....X......X...................................]
duration:
2.60614738s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:59:36 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.606173346s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.000508688s
target:
https://ap1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/202098c90d65b336
FAIL (2025-12-23 15:59:36 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout
Duration: 30.00053541s core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [............X.....X......X..................................]
duration:
2.743598131s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:59:13 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.743690157s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [..X..............X............X.............................]
duration:
901.021432ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:59:00 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 901.050393ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................]
duration:
260.707703ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:58:49 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 260.740493ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
2.471241039s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:58:44 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.471269208s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................]
duration:
257.607836ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:58:32 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 257.634134ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...X..............X............X............................]
duration:
798.673328ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:58:13 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 798.790057ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.............X.....X......X.................................]
duration:
2.546262891s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:58:08 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.546289694s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................]
duration:
258.188095ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:58:06 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 258.210938ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
2.512353157s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:57:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.51237679s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
2.477509216s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:57:36 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.477535263s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [..............X.....X......X................................]
duration:
2.634020827s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:57:31 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.634098432s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [....X..............X............X...........................]
duration:
826.813025ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:57:16 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 826.842402ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [...............X.....X......X...............................]
duration:
2.51880958s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:57:09 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.5188392s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................]
duration:
259.107485ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:57:08 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 259.165554ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................]
duration:
260.054356ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:56:36 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 260.078941ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.....X..............X............X..........................]
duration:
810.22946ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:56:34 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 810.257254ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
2.086851836s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:56:28 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.086944743s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [................X.....X......X..............................]
duration:
2.585419747s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:56:23 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.585448888s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
2.106049696s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:55:59 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.106076854s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................]
duration:
259.718313ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:55:57 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 259.73699ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.................X.....X......X.............................]
duration:
2.616884678s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:55:53 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.616914142s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [......X..............X............X.........................]
duration:
882.504759ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:55:50 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 882.529278ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................]
duration:
264.701551ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:55:28 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 264.723922ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [..................X.....X......X............................]
duration:
2.749711243s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:55:15 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.749739153s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [X......................X....................................]
duration:
2.478288291s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:55:12 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.478314849s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................]
duration:
258.458331ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:55:11 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 258.484112ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.......X..............X............X........................]
duration:
830.963549ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:54:57 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 831.008936ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [.X......................X...................................]
duration:
2.515280252s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:54:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.515377258s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................]
duration:
259.890053ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:54:31 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 259.916255ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [...................X.....X......X...........................]
duration:
2.880051283s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:54:18 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.880078741s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................]
duration:
257.016143ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:54:13 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 257.046161ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [..X......................X..................................]
duration:
2.504701327s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:54:10 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.50472707s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [........X..............X............X.......................]
duration:
809.393609ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:54:07 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 809.419945ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [....................X.....X......X..........................]
duration:
2.68738811s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:53:59 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.687404687s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [...X......................X.................................]
duration:
2.50755011s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:53:49 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.50757736s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................]
duration:
259.082383ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:53:45 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 259.108101ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.....................X.....X......X.........................]
duration:
2.58237027s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:53:35 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.582395371s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........X..............X............X......................]
duration:
878.814457ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:53:26 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 878.90035ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [....X......................X................................]
duration:
2.166599951s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:52:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.166625511s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [..........X..............X............X.....................]
duration:
805.284822ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:52:49 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 805.313898ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................]
duration:
256.448799ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:52:38 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 256.4757ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [......................X.....X......X........................]
duration:
2.564091663s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:52:36 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.564127807s core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................]
duration:
259.263853ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:52:23 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 259.290948ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.......................X.....X......X.......................]
duration:
2.587368973s
trace:
https://jaeger.dev.storj.io/trace/1c73e00ae4f6065c
FAIL (2025-12-23 15:52:09 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.587398519s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [.....X......................X...............................]
duration:
2.558567938s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:52:06 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.558594486s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...........X..............X............X....................]
duration:
888.509146ms
trace:
https://jaeger.dev.storj.io/trace/67795d781c8f55f2
FAIL (2025-12-23 15:51:50 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 888.549958ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................]
duration:
268.206643ms
target:
https://eu1.storj.io/login
trace:
https://jaeger.dev.storj.io/trace/3c8a15cd801ebdc1
FAIL (2025-12-23 15:51:43 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 268.221417ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [......X......................X..............................]
duration:
2.050027441s
trace:
https://jaeger.dev.storj.io/trace/20ee6d11665285b1
FAIL (2025-12-23 15:51:14 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450238296 (432h0m51.27794669s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450284693 (432h0m51.277993094s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.450928506 (432h0m51.2786369s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451455886 (432h0m51.279164277s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.451726821 (432h0m51.279435218s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452155821 (432h0m51.279864216s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.452617301 (432h0m51.280325695s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453031906 (432h0m51.280740306s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453464313 (432h0m51.281172704s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.453833854 (432h0m51.281542232s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Uploading piece...
Dec 23 15:28:50.873749393 (432h0m51.701457785s) [upload=449474]: Next returned nil segment
Dec 23 15:28:50.873762459 (432h0m51.701470849s) [upload=449474]: Waiting for error group managing segments...
Dec 23 15:28:51.042505138 (432h0m51.870213541s) [noise=true , address=81.171.14.70:4036    , piece_id=T6353GQC3VCIXARGB7JB66ROB4HXB54ZJEN2NLZQZSCXGFAVPBBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.047157036 (432h0m51.874865439s) [noise=true , address=81.171.14.70:4039    , piece_id=5JFM3FGX4UXUKJDDUR6QKPEO2Q6PQXICVFIHLMCYUCHM3WRBD4GA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.061283412 (432h0m51.888991827s) [noise=true , address=185.167.204.206:4066 , piece_id=TXAR7UAXS4MKKGJHLSTE7KW53JKPV6BZVMUXMTPATMYM3SLKOGGQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.062400429 (432h0m51.89010882s) [noise=true , address=89.149.201.147:4005  , piece_id=CJBMKELGKRI6W72QLOL2PWTLYE47U224EEC34ELC5VVMIU6Y3GYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.066410014 (432h0m51.894118413s) [noise=true , address=185.167.204.205:4009 , piece_id=QOWW2X6YAMSGYW3BC7ZRPNLZ6ZZJ3CQVSYACJDWHLJNAMDMBQPBA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.095270986 (432h0m51.92297939s) [noise=true , address=185.167.204.206:4047 , piece_id=ONFTXH7MBLSGVMBOQUKM2SLMAEJ52TZIEDNABNC22D7VXVPCXY5Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.100596666 (432h0m51.928305061s) [noise=true , address=185.167.204.205:4019 , piece_id=JAQWQNVVW7DUV5H7O52ILYHN55VVWADGGAYFBDK4VM7AZWNAXCRQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.103560142 (432h0m51.93126853s) [noise=true , address=81.171.14.70:4025    , piece_id=WGTWZVCDY4N2FGSOCKQEDS5MC25AHPI2MFBF2VRO47ZF5E65CY2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.118031585 (432h0m51.945739979s) [noise=true , address=185.167.204.205:4021 , piece_id=7D7PQWUUQ6OV66VP73XGLAURNLQFOX5YT3MURRQSAN66VKA3DKYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.128062622 (432h0m51.955771018s) [noise=true , address=185.167.204.206:4051 , piece_id=LH4GXQ2MP4BXROJBXAFHEWJZMGSBRWNBITLF37NNFCDLB7IEPQLA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.134397721 (432h0m51.962106124s) [noise=true , address=89.149.201.147:4009  , piece_id=NLGLDZI6VRLXIP2S3G6E6BCK6ERGF3LKIHGKKYDRTDU7IAE3MOEA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.163106517 (432h0m51.990814919s) [noise=true , address=185.167.204.206:4054 , piece_id=G4Q6U5WSHNOBV5YE3HVZFZODWX3NJ2J67WATNLF47ZJVAIDR7CNQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.187215887 (432h0m52.014924285s) [noise=true , address=185.167.204.205:4005 , piece_id=SMS6QSW26MFG6ZWXS43SJNVKW5L2KC2HZVIB5ZN6ARTZE7VCDXFQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.191385548 (432h0m52.019093943s) [noise=true , address=185.167.204.205:4025 , piece_id=STHOVH3EE4E5EGHV3YXD7PAK7HL64A4YZX5I2L7REVBDM7SOXG4A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.232740501 (432h0m52.060448892s) [noise=true , address=185.167.204.206:4067 , piece_id=A5Z7XL6JY37OWKH3ZDC5A2W73ERAQCS2WIOXASUHEX3CPYCG2PYQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.254566742 (432h0m52.082275133s) [noise=true , address=185.167.204.206:4052 , piece_id=KWPFK2SOTESIA4YWLNPM6CES7DUPWCSVAI3E5UDYK6YSNM3EFEOA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.292399281 (432h0m52.120107676s) [noise=true , address=185.167.204.206:4071 , piece_id=SLOZ43XJOYRWOK4FHBYSQFFLIZMHVOHKMVIDJL37GXVT2JRDPWKQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.495257157 (432h0m52.322965538s) [noise=true , address=185.167.204.205:4018 , piece_id=XAIHJLWSUIGGHLKETNCWUAUCA76QOHNN3BD6H3H47XQMONNHDVCQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.509483881 (432h0m52.337192272s) [noise=true , address=81.171.14.70:4035    , piece_id=YIAIQHW5HLQS63JX6TITC3YZKBNH3BC5YYJ7DNC7EWCXL6ILDHOQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.519317972 (432h0m52.347026369s) [noise=true , address=81.171.14.70:4033    , piece_id=4RARLBHMGEOWN6SS2DKQ6DVWSUO54G4LV5UP2LYOGJAZDEEWD2CA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.540953811 (432h0m52.368662212s) [noise=true , address=89.149.201.147:4017  , piece_id=YKTOFL6L2A2OSVXSM2NW5MGXFHVXH4QYBIO2XWLWOH5ANRM2NHYA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.555541803 (432h0m52.383250199s) [noise=true , address=81.171.14.70:4040    , piece_id=IYET6GALTRUFQX34RVXLM4WUVWTKGP2HAATO3DRNBBOC7RX4BPDA, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.561754672 (432h0m52.389463063s) [noise=true , address=89.149.201.147:4020  , piece_id=PMCD7ZHETP3AEJBEZT2GUWMMQBQDW52T2AGQINLWB63O4IQ7PSWQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.565484488 (432h0m52.393192887s) [noise=true , address=89.149.201.147:4008  , piece_id=2FME7O25WWJGPW3QR7SNATQXK4UA2KZIN7J2ZUNRQTM67NVR2Y2Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.580597563 (432h0m52.408305955s) [noise=true , address=81.171.14.70:4027    , piece_id=FRRLBX6EMKUAEFNELKYS3WPNG6CDYX7WCBLVPHAW3AZGQBMB3V3A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596579728 (432h0m52.424288127s) [noise=true , address=81.171.14.70:4043    , piece_id=MJM5262FY7HLPJHDZU7Z5FOZKGQG6XLIEGHB3W3PECXJOUATGNBQ, seg_pos={0 0}, upload=449474]: Done uploading piece. err: <nil>
Dec 23 15:28:51.596646083 (432h0m52.424354476s) [seg_pos={0 0}, upload=449474]: Segment reached optimal threshold of 26 pieces.
Dec 23 15:28:51.597463826 (432h0m52.425172227s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.597488049 (432h0m52.425196452s) [noise=true , address=89.149.201.147:4024  , piece_id=KNY2LKNZAIKFSIHLQ4B7EY766SW4HYVRQY6ZOSOYPH2OZFSRB65Q, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598037697 (432h0m52.425746098s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T7zKyoeXVwkgTKXkQqvXi28sWXHE9vRdcNYg7xR8tWFxdtDqf): protocol: expected piece hash; context canceled; EOF
Dec 23 15:28:51.598080201 (432h0m52.425788602s) [noise=true , address=81.171.14.70:4032    , piece_id=JHQOOLIUO5ILW6JQQW5OTTKNOHIMH5XYDMQ4MHUAPYWFJX2UH57A, seg_pos={0 0}, upload=449474]: Long tail cancellation due to optimal threshold
Dec 23 15:28:51.598169558 (432h0m52.425877955s) [seg_pos={0 0}, upload=449474]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Dec 23 15:28:51.598361733 (432h0m52.426070137s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 23 15:28:51.598386842 (432h0m52.426095234s) [upload=449474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 23 15:29:47.549935238 (432h1m48.377643635s) [upload=449474]: Done uploading segments...
Dec 23 15:29:47.550073441 (432h1m48.377781841s) [upload=449474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.050055637s core uplink eu-select-1 eu1-placement-15