Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
54.740297905s trace:
https://jaeger.dev.storj.io/trace/5e95e001955ee5b9
FAIL (2026-03-10 18:21:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
, address=89.149.201.147:4014 , piece_id=UQSDYL6TIICACSW3B64V3BAZWEOUVTBQMK44HRFWYQTOX2JSTPJQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.226415607 (103h19m32.823186625s) [noise=true , address=185.167.204.206:4049 , piece_id=HD5TQPI6NW6GZLA2GHM5CLGKTOM4LYIQYH6D4BZ5EMD52YZDBY3Q, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.229137811 (103h19m32.825908827s) [noise=true , address=89.149.201.147:4016 , piece_id=HUUUQVWZSFDIHHMGZRCD3K6GK57SQKDBO7HMQ6DBO4Y5FHK4E3AA, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.232909424 (103h19m32.829680437s) [noise=true , address=185.167.204.205:4020 , piece_id=5FJQI37K5R74ZUWXCJZWKFBKKZSXPPZN4M4HKJ25E5FK7XWQY3BQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.239159038 (103h19m32.835930054s) [noise=true , address=185.167.204.205:4005 , piece_id=7Y6XW2ZDGPSKPSJ3JEOKAFRRG5PUSGXTN6GQDN5TUV5X4ZCZ2WXQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.241027123 (103h19m32.837798137s) [noise=true , address=89.149.201.147:4009 , piece_id=ECNFO4GOL5NSXUNS6DBSELF3623KUNPTQXUDGDU2CNBEUHMJXZ4Q, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.242045917 (103h19m32.838816934s) [noise=true , address=185.167.204.206:4050 , piece_id=SO6FICYXPSKGQLHNDY4Q4HMSS6HIZHCGFSXZTR4ZVV73FFTYELUQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.244248381 (103h19m32.84101939s) [noise=true , address=185.167.204.205:4014 , piece_id=RC4G6B36AJ5RAZ4AB45OHJKWEWHVGCVBN2KBOGOGMIF4BEYOO3OQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.246388125 (103h19m32.843159141s) [noise=true , address=81.171.14.70:4035 , piece_id=WB5O2MZ4VZRDWX6TB5FP3XFO4INBMNZM7DTGIXHXF6WJ3Z5BY6EQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.246525590 (103h19m32.843296608s) [noise=true , address=185.167.204.206:4043 , piece_id=I2GTD7RZFP5LBOLG24KFOMZRR6GRLB3VXPJUT7KC2S7ADPOPUDRA, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.248403422 (103h19m32.845174441s) [noise=true , address=89.149.201.147:4002 , piece_id=UB3WE3LIHTK7MC6I5L6WJBDFB3EMTVVL6ZMQWEQWLUHEKDGV4XFQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.248951823 (103h19m32.84572284s) [noise=true , address=185.167.204.205:4019 , piece_id=XVPVNOTQTPJPRGXFH67TVVXYCEDC7U6XP2RPA4KWTX4AVBFWUXEQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.616832511 (103h19m33.213603542s) [upload=115653]: Next returned nil segment
Mar 10 18:19:35.616849321 (103h19m33.213620369s) [upload=115653]: Waiting for error group managing segments...
Mar 10 18:19:35.810806844 (103h19m33.407577867s) [noise=true , address=81.171.14.70:4043 , piece_id=KG3YSFUEWQUPUL5HPMUZVUYE6MYPK2GVQQFIGO4IWUXVRMSAVSHA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.810960076 (103h19m33.407731099s) [noise=true , address=81.171.14.70:4030 , piece_id=N3C7SQ4Y26RJVC5EAB5ASEMEMPDO2YAT4X6R2FGGSQHCMTOUME7A, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.818910271 (103h19m33.415681302s) [noise=true , address=81.171.14.70:4047 , piece_id=NTUAA6WV4DIVMMYOTSJWZP4PEDA2STSMGXDEIWJOEG66GV2IP52A, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.821210624 (103h19m33.417981649s) [noise=true , address=185.167.204.206:4044 , piece_id=IOGPHO2IMLM4WJPXRYEODPAILYVAW35E7OYNBATYMOADMHBVTAEA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.834331969 (103h19m33.431102982s) [noise=true , address=81.171.14.70:4025 , piece_id=NWFY7S6Z4P2JZRKNB7DCJHH6KVWEJX673OYQAYAAQYBOOBQMN7KA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.867592710 (103h19m33.464363736s) [noise=true , address=89.149.201.147:4016 , piece_id=HUUUQVWZSFDIHHMGZRCD3K6GK57SQKDBO7HMQ6DBO4Y5FHK4E3AA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.869995030 (103h19m33.466766053s) [noise=true , address=185.167.204.205:4007 , piece_id=VZDOYSXJNSUBIBFOWPFSA2P5K4MI2QYJG4RQ4TQ2TJHFR6NMY5HA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.874770892 (103h19m33.471541929s) [noise=true , address=185.167.204.205:4016 , piece_id=JUTDYPCLBRXBPXROVUIXF46FQ5R6CMFVX6NWYNTNBA4ILORZPJVQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.889847511 (103h19m33.486618544s) [noise=true , address=89.149.201.147:4006 , piece_id=URPQHEVCEFNWMVX2UDBUOEXNGCIA7CNN6CTRBEQ4QV3FX3PUFOSA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.894492116 (103h19m33.491263146s) [noise=true , address=89.149.201.147:4014 , piece_id=UQSDYL6TIICACSW3B64V3BAZWEOUVTBQMK44HRFWYQTOX2JSTPJQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.899603360 (103h19m33.496374369s) [noise=true , address=89.149.201.147:4022 , piece_id=XX32YI3C5N75XNYAAFPGO4J76KWB2KAVR7OYXFBUYL45IAZP5QNQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.909066435 (103h19m33.505837459s) [noise=true , address=185.167.204.206:4070 , piece_id=BO4U37EMJ3FW5JILWTXBCZDEJWJLNSXC2IVTDXIMBILLVT4P2KYQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.909655371 (103h19m33.506426399s) [noise=true , address=89.149.201.147:4015 , piece_id=7OJ7MOPW7UG3Y7VQVM7Y5BWHYAJFEPTOQPBAPODLQBGAJYU7ERTQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.912670765 (103h19m33.509441793s) [noise=true , address=185.167.204.205:4005 , piece_id=7Y6XW2ZDGPSKPSJ3JEOKAFRRG5PUSGXTN6GQDN5TUV5X4ZCZ2WXQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.917769965 (103h19m33.514540992s) [noise=true , address=185.167.204.205:4014 , piece_id=RC4G6B36AJ5RAZ4AB45OHJKWEWHVGCVBN2KBOGOGMIF4BEYOO3OQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.925026294 (103h19m33.521797319s) [noise=true , address=185.167.204.206:4050 , piece_id=SO6FICYXPSKGQLHNDY4Q4HMSS6HIZHCGFSXZTR4ZVV73FFTYELUQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.931218169 (103h19m33.527989196s) [noise=true , address=185.167.204.205:4020 , piece_id=5FJQI37K5R74ZUWXCJZWKFBKKZSXPPZN4M4HKJ25E5FK7XWQY3BQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.932952746 (103h19m33.529723781s) [noise=true , address=185.167.204.205:4009 , piece_id=XN73S4H5BGQKLUQWICEXRH7RQV4L7FYGS6CFDBH3V53NGBZBDAMQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.944198414 (103h19m33.540969446s) [noise=true , address=185.167.204.205:4019 , piece_id=XVPVNOTQTPJPRGXFH67TVVXYCEDC7U6XP2RPA4KWTX4AVBFWUXEQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.950937978 (103h19m33.547708991s) [noise=true , address=185.167.204.205:4035 , piece_id=H4OKKVGRHJZCTASRNNETURODJE7FC2DUZJD6CKD3ONEWNY36PGNA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.951080419 (103h19m33.547851432s) [noise=true , address=185.167.204.205:4028 , piece_id=TC57OJQ6BA24NO27OGHI7KBVPCJK35IV5EQ6SQAKQL46BA3YWDEA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.956570986 (103h19m33.553342013s) [noise=true , address=185.167.204.206:4049 , piece_id=HD5TQPI6NW6GZLA2GHM5CLGKTOM4LYIQYH6D4BZ5EMD52YZDBY3Q, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:36.260422274 (103h19m33.857193301s) [noise=true , address=89.149.201.147:4010 , piece_id=XOB2KBJX2JMBITMAKDGHQKSTX3H63WRW2WWPMXI5RD5ZP7F7FBLA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:36.294530007 (103h19m33.89130103s) [noise=true , address=81.171.14.70:4035 , piece_id=WB5O2MZ4VZRDWX6TB5FP3XFO4INBMNZM7DTGIXHXF6WJ3Z5BY6EQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:36.340503759 (103h19m33.937274801s) [noise=true , address=89.149.201.147:4020 , piece_id=I2KYV66QPQRWS3C27NKWQDW4ITYSLFB6XUCY7UHZLQK5WKYTAU4Q, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:20:34.740126747 (103h20m32.336897775s) [noise=true , address=89.149.201.147:4002 , piece_id=UB3WE3LIHTK7MC6I5L6WJBDFB3EMTVVL6ZMQWEQWLUHEKDGV4XFQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:33340->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:20:34.740414606 (103h20m32.337185632s) [noise=true , address=185.167.204.206:4043 , piece_id=I2GTD7RZFP5LBOLG24KFOMZRR6GRLB3VXPJUT7KC2S7ADPOPUDRA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: read tcp 159.223.143.39:56250->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:20:34.740666088 (103h20m32.337437119s) [noise=true , address=89.149.201.147:4009 , piece_id=ECNFO4GOL5NSXUNS6DBSELF3623KUNPTQXUDGDU2CNBEUHMJXZ4Q, seg_pos={0 0}, upload=115653]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:34182->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:20:34.740735449 (103h20m32.337506487s) [seg_pos={0 0}, upload=115653]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 18:20:34.837288406 (103h20m32.434059429s) [upload=115653]: Done uploading segments...
Mar 10 18:20:34.837328146 (103h20m32.434099169s) [upload=115653]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 54.740317228s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.100389894s trace:
https://jaeger.dev.storj.io/trace/5e95e001955ee5b9
FAIL (2026-03-10 18:20:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
, address=89.149.201.147:4014 , piece_id=UQSDYL6TIICACSW3B64V3BAZWEOUVTBQMK44HRFWYQTOX2JSTPJQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.226415607 (103h19m32.823186625s) [noise=true , address=185.167.204.206:4049 , piece_id=HD5TQPI6NW6GZLA2GHM5CLGKTOM4LYIQYH6D4BZ5EMD52YZDBY3Q, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.229137811 (103h19m32.825908827s) [noise=true , address=89.149.201.147:4016 , piece_id=HUUUQVWZSFDIHHMGZRCD3K6GK57SQKDBO7HMQ6DBO4Y5FHK4E3AA, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.232909424 (103h19m32.829680437s) [noise=true , address=185.167.204.205:4020 , piece_id=5FJQI37K5R74ZUWXCJZWKFBKKZSXPPZN4M4HKJ25E5FK7XWQY3BQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.239159038 (103h19m32.835930054s) [noise=true , address=185.167.204.205:4005 , piece_id=7Y6XW2ZDGPSKPSJ3JEOKAFRRG5PUSGXTN6GQDN5TUV5X4ZCZ2WXQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.241027123 (103h19m32.837798137s) [noise=true , address=89.149.201.147:4009 , piece_id=ECNFO4GOL5NSXUNS6DBSELF3623KUNPTQXUDGDU2CNBEUHMJXZ4Q, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.242045917 (103h19m32.838816934s) [noise=true , address=185.167.204.206:4050 , piece_id=SO6FICYXPSKGQLHNDY4Q4HMSS6HIZHCGFSXZTR4ZVV73FFTYELUQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.244248381 (103h19m32.84101939s) [noise=true , address=185.167.204.205:4014 , piece_id=RC4G6B36AJ5RAZ4AB45OHJKWEWHVGCVBN2KBOGOGMIF4BEYOO3OQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.246388125 (103h19m32.843159141s) [noise=true , address=81.171.14.70:4035 , piece_id=WB5O2MZ4VZRDWX6TB5FP3XFO4INBMNZM7DTGIXHXF6WJ3Z5BY6EQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.246525590 (103h19m32.843296608s) [noise=true , address=185.167.204.206:4043 , piece_id=I2GTD7RZFP5LBOLG24KFOMZRR6GRLB3VXPJUT7KC2S7ADPOPUDRA, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.248403422 (103h19m32.845174441s) [noise=true , address=89.149.201.147:4002 , piece_id=UB3WE3LIHTK7MC6I5L6WJBDFB3EMTVVL6ZMQWEQWLUHEKDGV4XFQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.248951823 (103h19m32.84572284s) [noise=true , address=185.167.204.205:4019 , piece_id=XVPVNOTQTPJPRGXFH67TVVXYCEDC7U6XP2RPA4KWTX4AVBFWUXEQ, seg_pos={0 0}, upload=115653]: Uploading piece...
Mar 10 18:19:35.616832511 (103h19m33.213603542s) [upload=115653]: Next returned nil segment
Mar 10 18:19:35.616849321 (103h19m33.213620369s) [upload=115653]: Waiting for error group managing segments...
Mar 10 18:19:35.810806844 (103h19m33.407577867s) [noise=true , address=81.171.14.70:4043 , piece_id=KG3YSFUEWQUPUL5HPMUZVUYE6MYPK2GVQQFIGO4IWUXVRMSAVSHA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.810960076 (103h19m33.407731099s) [noise=true , address=81.171.14.70:4030 , piece_id=N3C7SQ4Y26RJVC5EAB5ASEMEMPDO2YAT4X6R2FGGSQHCMTOUME7A, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.818910271 (103h19m33.415681302s) [noise=true , address=81.171.14.70:4047 , piece_id=NTUAA6WV4DIVMMYOTSJWZP4PEDA2STSMGXDEIWJOEG66GV2IP52A, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.821210624 (103h19m33.417981649s) [noise=true , address=185.167.204.206:4044 , piece_id=IOGPHO2IMLM4WJPXRYEODPAILYVAW35E7OYNBATYMOADMHBVTAEA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.834331969 (103h19m33.431102982s) [noise=true , address=81.171.14.70:4025 , piece_id=NWFY7S6Z4P2JZRKNB7DCJHH6KVWEJX673OYQAYAAQYBOOBQMN7KA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.867592710 (103h19m33.464363736s) [noise=true , address=89.149.201.147:4016 , piece_id=HUUUQVWZSFDIHHMGZRCD3K6GK57SQKDBO7HMQ6DBO4Y5FHK4E3AA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.869995030 (103h19m33.466766053s) [noise=true , address=185.167.204.205:4007 , piece_id=VZDOYSXJNSUBIBFOWPFSA2P5K4MI2QYJG4RQ4TQ2TJHFR6NMY5HA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.874770892 (103h19m33.471541929s) [noise=true , address=185.167.204.205:4016 , piece_id=JUTDYPCLBRXBPXROVUIXF46FQ5R6CMFVX6NWYNTNBA4ILORZPJVQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.889847511 (103h19m33.486618544s) [noise=true , address=89.149.201.147:4006 , piece_id=URPQHEVCEFNWMVX2UDBUOEXNGCIA7CNN6CTRBEQ4QV3FX3PUFOSA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.894492116 (103h19m33.491263146s) [noise=true , address=89.149.201.147:4014 , piece_id=UQSDYL6TIICACSW3B64V3BAZWEOUVTBQMK44HRFWYQTOX2JSTPJQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.899603360 (103h19m33.496374369s) [noise=true , address=89.149.201.147:4022 , piece_id=XX32YI3C5N75XNYAAFPGO4J76KWB2KAVR7OYXFBUYL45IAZP5QNQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.909066435 (103h19m33.505837459s) [noise=true , address=185.167.204.206:4070 , piece_id=BO4U37EMJ3FW5JILWTXBCZDEJWJLNSXC2IVTDXIMBILLVT4P2KYQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.909655371 (103h19m33.506426399s) [noise=true , address=89.149.201.147:4015 , piece_id=7OJ7MOPW7UG3Y7VQVM7Y5BWHYAJFEPTOQPBAPODLQBGAJYU7ERTQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.912670765 (103h19m33.509441793s) [noise=true , address=185.167.204.205:4005 , piece_id=7Y6XW2ZDGPSKPSJ3JEOKAFRRG5PUSGXTN6GQDN5TUV5X4ZCZ2WXQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.917769965 (103h19m33.514540992s) [noise=true , address=185.167.204.205:4014 , piece_id=RC4G6B36AJ5RAZ4AB45OHJKWEWHVGCVBN2KBOGOGMIF4BEYOO3OQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.925026294 (103h19m33.521797319s) [noise=true , address=185.167.204.206:4050 , piece_id=SO6FICYXPSKGQLHNDY4Q4HMSS6HIZHCGFSXZTR4ZVV73FFTYELUQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.931218169 (103h19m33.527989196s) [noise=true , address=185.167.204.205:4020 , piece_id=5FJQI37K5R74ZUWXCJZWKFBKKZSXPPZN4M4HKJ25E5FK7XWQY3BQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.932952746 (103h19m33.529723781s) [noise=true , address=185.167.204.205:4009 , piece_id=XN73S4H5BGQKLUQWICEXRH7RQV4L7FYGS6CFDBH3V53NGBZBDAMQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.944198414 (103h19m33.540969446s) [noise=true , address=185.167.204.205:4019 , piece_id=XVPVNOTQTPJPRGXFH67TVVXYCEDC7U6XP2RPA4KWTX4AVBFWUXEQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.950937978 (103h19m33.547708991s) [noise=true , address=185.167.204.205:4035 , piece_id=H4OKKVGRHJZCTASRNNETURODJE7FC2DUZJD6CKD3ONEWNY36PGNA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.951080419 (103h19m33.547851432s) [noise=true , address=185.167.204.205:4028 , piece_id=TC57OJQ6BA24NO27OGHI7KBVPCJK35IV5EQ6SQAKQL46BA3YWDEA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:35.956570986 (103h19m33.553342013s) [noise=true , address=185.167.204.206:4049 , piece_id=HD5TQPI6NW6GZLA2GHM5CLGKTOM4LYIQYH6D4BZ5EMD52YZDBY3Q, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:36.260422274 (103h19m33.857193301s) [noise=true , address=89.149.201.147:4010 , piece_id=XOB2KBJX2JMBITMAKDGHQKSTX3H63WRW2WWPMXI5RD5ZP7F7FBLA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:36.294530007 (103h19m33.89130103s) [noise=true , address=81.171.14.70:4035 , piece_id=WB5O2MZ4VZRDWX6TB5FP3XFO4INBMNZM7DTGIXHXF6WJ3Z5BY6EQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:19:36.340503759 (103h19m33.937274801s) [noise=true , address=89.149.201.147:4020 , piece_id=I2KYV66QPQRWS3C27NKWQDW4ITYSLFB6XUCY7UHZLQK5WKYTAU4Q, seg_pos={0 0}, upload=115653]: Done uploading piece. err: <nil>
Mar 10 18:20:34.740126747 (103h20m32.336897775s) [noise=true , address=89.149.201.147:4002 , piece_id=UB3WE3LIHTK7MC6I5L6WJBDFB3EMTVVL6ZMQWEQWLUHEKDGV4XFQ, seg_pos={0 0}, upload=115653]: Done uploading piece. err: ecclient: upload failed (node:12RDCCUcFecPi2tRuk69SueE84EdSssocDPB4WEmUQaXGacDAhc, address:89.149.201.147:4002): protocol: read tcp 159.223.143.39:33340->89.149.201.147:4002: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:20:34.740414606 (103h20m32.337185632s) [noise=true , address=185.167.204.206:4043 , piece_id=I2GTD7RZFP5LBOLG24KFOMZRR6GRLB3VXPJUT7KC2S7ADPOPUDRA, seg_pos={0 0}, upload=115653]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: read tcp 159.223.143.39:56250->185.167.204.206:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:20:34.740666088 (103h20m32.337437119s) [noise=true , address=89.149.201.147:4009 , piece_id=ECNFO4GOL5NSXUNS6DBSELF3623KUNPTQXUDGDU2CNBEUHMJXZ4Q, seg_pos={0 0}, upload=115653]: Done uploading piece. err: ecclient: upload failed (node:1sbZWJFMVsppCpbFVfn33bx5uGkhtFpzJm8a2i8DoAfQNsWY5F, address:89.149.201.147:4009): protocol: read tcp 159.223.143.39:34182->89.149.201.147:4009: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:20:34.740735449 (103h20m32.337506487s) [seg_pos={0 0}, upload=115653]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 18:20:34.837288406 (103h20m32.434059429s) [upload=115653]: Done uploading segments...
Mar 10 18:20:34.837328146 (103h20m32.434099169s) [upload=115653]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.100412209s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.221788737s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:30:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.221835738s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
2.231955928s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:30:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.23204733s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
2.140553985s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:28:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.140601063s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
4 out of 60 is failed (threshold=3) [XXXX........................................................] duration:
2.08857756s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:28:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.088603033s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
5 out of 60 is failed (threshold=3) [XXXXX.......................................................] duration:
2.123301472s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:28:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.123318184s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
6 out of 60 is failed (threshold=3) [XXXXXX......................................................] duration:
2.144727414s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:27:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.144760845s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
7 out of 60 is failed (threshold=3) [XXXXXXX.....................................................] duration:
2.102296568s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:26:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.102323543s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
8 out of 60 is failed (threshold=3) [XXXXXXXX....................................................] duration:
2.056549418s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:26:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.056577642s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
9 out of 60 is failed (threshold=3) [XXXXXXXXX...................................................] duration:
2.089321777s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:25:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.089349904s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
10 out of 60 is failed (threshold=3) [XXXXXXXXXX..................................................] duration:
2.081242698s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:24:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.081269646s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
11 out of 60 is failed (threshold=3) [XXXXXXXXXXX.................................................] duration:
2.191637188s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:23:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.191676665s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
12 out of 60 is failed (threshold=3) [XXXXXXXXXXXX................................................] duration:
2.116999758s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:23:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.117038772s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
13 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX...............................................] duration:
2.105120656s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:21:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.105149343s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX..............................................] duration:
2.136353024s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:21:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.136387776s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................] duration:
2.095985485s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:21:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.096024924s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX............................................] duration:
2.188779998s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:20:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.188868846s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................] duration:
2.021964641s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:19:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.022004817s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................] duration:
2.134328246s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:19:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.134364362s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................] duration:
2.199260369s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:18:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.199285099s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX........................................] duration:
2.419390598s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:17:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.419438483s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXX.......................................] duration:
2.115088143s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:16:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.115116347s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX......................................] duration:
2.18073076s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:15:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.180769638s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.....................................] duration:
2.271208258s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:15:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.271290488s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
24 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXX....................................] duration:
2.131327189s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:14:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.131421704s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
25 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXX...................................] duration:
2.098584398s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:13:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.098629034s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
26 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXX..................................] duration:
2.039768111s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:13:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.039803185s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
27 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXX.................................] duration:
2.223784505s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:12:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.22381328s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
28 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXX................................] duration:
2.194749941s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:11:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.194780624s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
29 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXX...............................] duration:
2.18997243s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:10:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.190013996s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
30 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..............................] duration:
2.12513674s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:09:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.125171194s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
31 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.............................] duration:
2.129063204s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:08:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.129089553s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
32 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX............................] duration:
2.153018793s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:07:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.153064726s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
33 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...........................] duration:
2.106937198s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:06:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.106962159s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
34 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..........................] duration:
2.091852265s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:05:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.091890524s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
35 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.........................] duration:
2.134765519s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:05:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.134801186s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
36 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX........................] duration:
2.07102171s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:04:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.071048613s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
37 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.......................] duration:
2.145436975s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:04:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.145463845s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
38 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX......................] duration:
2.540257314s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:03:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.54028594s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
39 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....................] duration:
2.148880139s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:02:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.148940006s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
40 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....................] duration:
2.052338245s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:01:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.052364446s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
41 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...................] duration:
2.145632589s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 16:00:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.145730963s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
42 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..................] duration:
2.113635535s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:59:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.113665787s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
43 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.................] duration:
2.109833003s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:59:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.109926884s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
44 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX................] duration:
2.056932483s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:58:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.056963847s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
45 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...............] duration:
2.060387892s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:57:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.060412694s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
46 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX..............] duration:
2.016662639s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:57:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.016689151s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
47 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.............] duration:
2.124670711s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:57:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.124694563s
core
uplink
uk-select-1
uk1-placement-17
|
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)antiblip:
48 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX............] duration:
2.116402242s trace:
https://jaeger.dev.storj.io/trace/3f1de8482549ff6d
FAIL (2026-03-10 15:56:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 ======LOGS====== Mar 10 15:47:16.243685279 (100h47m13.840456293s) [upload=112809]: Starting upload Mar 10 15:47:16.243853880 (100h47m13.840624904s) [upload=112809]: Done starting upload Mar 10 15:47:16.243952031 (100h47m13.840723047s) [upload=112809]: Uploading segments... Mar 10 15:47:16.244418325 (100h47m13.841189367s) [upload=112809]: Got next segment. Inline: false Mar 10 15:47:16.244500226 (100h47m13.841271257s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Mar 10 15:47:16.244507371 (100h47m13.841278402s) [upload=112809]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Mar 10 15:47:16.343286550 (100h47m13.940057582s) [upload=112809]: Next segment err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0 Mar 10 15:47:16.343311273 (100h47m13.940082305s) [upload=112809]: Done uploading segments... Mar 10 15:47:16.343369225 (100h47m13.940140237s) [upload=112809]: Upload finished. err: metaclient: not enough nodes: not enough nodes: requested from cache 20, found 0
Duration: 2.116483455s
core
uplink
uk-select-1
uk1-placement-17
|