Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.44064457s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:08:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 2.440693614s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.909351471s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:07:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.909379403s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.977281174s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:06:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.977313107s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.046594439s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:04:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 2.046618745s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 1.89785016s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:03:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.89787945s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.95461346s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:02:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.954639796s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 1.934039396s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:02:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.934095309s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.020650774s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:01:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 2.020679341s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 1.920689461s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:01:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.920719941s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.011767601s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 01:00:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 2.011798214s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 1.956133066s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:59:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.956177404s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 1.902466671s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:58:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.902494421s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.955445629s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:57:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.955508628s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.906376203s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:57:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.906547116s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.895561221s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:56:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.895590508s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.838243681s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:55:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.838281911s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.91907249s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:55:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.919096786s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.890203773s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:55:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.890227498s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.89638366s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:54:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.896408332s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.958445028s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:54:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.958471919s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.937785459s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:53:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.937812088s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.913989671s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:52:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.914072669s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.941669794s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:51:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1.941696307s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.238839016s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:51:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 2.238865645s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 25.374081177s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:50:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 25.37410994s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 37.307785419s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:49:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 37.307815092s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 21.621733513s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:48:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 21.621762231s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 31.653166512s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:48:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 31.653209448s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 17.651833283s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:47:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 17.651866879s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 21.908547846s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:46:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 21.908616005s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 17.343604033s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:45:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 17.343628544s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 39.786099246s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:45:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 39.786250912s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 17.534090851s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:44:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 17.534160626s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 24.866689727s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:43:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 24.866713551s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 21.659970488s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:42:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 21.660003572s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 25.369184846s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:41:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 25.369205041s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 23.758359287s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:41:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 23.758381667s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 34.777605329s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:41:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 34.777633946s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 20.063297542s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:40:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 20.063321828s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 21.358952339s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:39:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 21.358982107s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 19.78977183s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:38:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 19.789803268s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 22.831988356s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:38:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 22.83200475s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 14.35950773s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:37:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 14.35952811s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.004183707s trace: https://jaeger.dev.storj.io/trace/116fb63136b7258c FAIL (2026-03-12 00:36:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: eestream: context deadline exceeded ======LOGS====== load=149689]: Uploading piece... Mar 12 00:35:45.870157663 (133h35m43.466928696s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.870748221 (133h35m43.467519249s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871520585 (133h35m43.468291614s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.871619897 (133h35m43.468390931s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872089773 (133h35m43.468860803s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872223558 (133h35m43.468994582s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872522029 (133h35m43.469293052s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.872981308 (133h35m43.469752334s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873519843 (133h35m43.470290872s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.873936881 (133h35m43.470707904s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874299912 (133h35m43.471070938s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.874751304 (133h35m43.47152233s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876388472 (133h35m43.473159495s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.876896905 (133h35m43.473667929s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.878804068 (133h35m43.47557509s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:45.879710862 (133h35m43.47648188s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Uploading piece... Mar 12 00:35:49.930529953 (133h35m47.527300969s) [upload=149689]: Next returned nil segment Mar 12 00:35:49.930545799 (133h35m47.527316822s) [upload=149689]: Waiting for error group managing segments... Mar 12 00:35:50.898312063 (133h35m48.495083094s) [noise=true , address=212.102.52.214:4346 , piece_id=UJF4FPZMBR5GQ6MHQTF5GTCTNNVAWJM2L2SXW7GGNJAQNAIUHD2Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.905765918 (133h35m48.502536941s) [noise=true , address=212.102.52.216:4402 , piece_id=KOQBHTM3UMBRFZQMI65ULLFEFYYJOHFSVB55HZTHCTCBLEUOZ65A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:50.915640983 (133h35m48.512412012s) [noise=true , address=212.102.52.214:4349 , piece_id=W6SRV76BQ6NE2IEXCEF732RUEQKKAEMNJEDURJFVJLBKGOLMJM5A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:51.625369720 (133h35m49.222140746s) [noise=true , address=212.102.52.213:4321 , piece_id=2F27ZXLXUKYBR7APN2HMCCSPMX7Q2FEOKZRY6QCXZQ3BGMZTETTQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.435650710 (133h35m50.032421722s) [noise=true , address=212.102.52.215:4372 , piece_id=4A6SLM4LTCNKAFIL4S6SQGI7MBAB2K6IGLSTRXQJ3F3CMUAVUWZA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.444469444 (133h35m50.04124047s) [noise=true , address=212.102.52.217:4431 , piece_id=DSK2GALEE2OTVNT4OYUUHNSDN56PZAOFTTNVU7NIV6BF7K7XPT4A, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453738377 (133h35m50.050509389s) [noise=true , address=212.102.52.215:4371 , piece_id=JN6SOBRAQRPSP3KUHHBQZWPMOZ4KPXCPAAW4ZOB2BPL6WRBOSHEA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.453807128 (133h35m50.050578143s) [noise=true , address=212.102.52.216:4400 , piece_id=YAUISSLBOMFIABHJTNZPSEPORYWCMOM55VQQDLSPL6YWCGZJIP4Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:52.462812772 (133h35m50.059583795s) [noise=true , address=212.102.52.216:4415 , piece_id=ON56HAWJ3XSQCCJGL7NRRTJVZRQZZN2ZO5UK6EU567VPRGUV62VA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.747909234 (133h35m51.344680258s) [noise=true , address=212.102.52.217:4434 , piece_id=3VCTW2BQXOTHQORAEYN5TWL5GA77EOL2NMHZ43MY5GIPKDSXMTBA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.748044679 (133h35m51.344815706s) [noise=true , address=212.102.52.217:4430 , piece_id=4ECEHEWBLCTYEA5MM2JNBCKOGEGSAGVZ4EFGZJFUAD36AWPXLKYQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.753942765 (133h35m51.350713789s) [noise=true , address=212.102.52.215:4370 , piece_id=BQHUQOLZBDNH3ZRMJFFQNQJMZR3Q4EPQIEA4CNHSQN6RHPR6ZQZQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:53.767093543 (133h35m51.363864567s) [noise=true , address=212.102.52.214:4351 , piece_id=OPLAHJ6XB5VIKSIEE2Q7DUM2JKDO4CG5ZQ6FHZWJSNMTB3GDHKGQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.534761485 (133h35m52.13153252s) [noise=true , address=212.102.52.217:4436 , piece_id=XWWFBBMCBZXJ2USWPHO5GRRDTVZITDQPJTJIIE3NAI5OX27L4UUA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.546709062 (133h35m52.143480086s) [noise=true , address=212.102.52.214:4353 , piece_id=L44Z7EQGYJ5KW6TMIKL6JDFDHZZL6T5A3OQTSXP4OOORPI7CZHOQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547405013 (133h35m52.144176036s) [noise=true , address=212.102.52.213:4344 , piece_id=YPXLDXNHVRE6JXF3V6HAXVN2LM7KGAA45BN4CS7QCD5ZNKXVOOUQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547419063 (133h35m52.144190093s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 16 pieces Mar 12 00:35:54.547677884 (133h35m52.144448918s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o9pEghsBzskA6HC7HMDNF7XhJEQFvxBRx95cT7E2RuMxegnNz): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547687719 (133h35m52.144458777s) [noise=true , address=212.102.52.217:4437 , piece_id=L75D5KJNU4ADWD4LERHD5CCHMCSLT3AVDQZPS26OZOYKE32E7PVQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547704947 (133h35m52.144475971s) [noise=true , address=212.102.52.213:4325 , piece_id=B4H67AGO7PAUGH5KUG75GTOK62G7CAYM2B62YAYNMUBGLD72V67Q, seg_pos={0 0}, upload=149689]: Done uploading piece. err: <nil> Mar 12 00:35:54.547722444 (133h35m52.144493466s) [seg_pos={0 0}, upload=149689]: Satisfied cohort requirements after 17 pieces Mar 12 00:35:54.547834736 (133h35m52.144605769s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547842605 (133h35m52.144613631s) [noise=true , address=212.102.52.214:4362 , piece_id=DLV7NZEMY3DIKKMUFHI7QTAVO322TLGS4ULUPXFJGVZOPYP2JQHA, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547964853 (133h35m52.14473588s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fAGLyjawu1GJ6crrZAEJxVuVwEUHYnUNkvcden4QkK53cVwPy): protocol: expected piece hash; context canceled; EOF Mar 12 00:35:54.547971598 (133h35m52.144742624s) [noise=true , address=212.102.52.216:4399 , piece_id=DNIGRHXLGRBQ6FR77SFE5ADJ2GBUJI3CHCPQQXBXTCB3YEXZQLPQ, seg_pos={0 0}, upload=149689]: Long tail cancellation due to optimal threshold Mar 12 00:35:54.547992617 (133h35m52.14476363s) [seg_pos={0 0}, upload=149689]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> Mar 12 00:35:54.548083620 (133h35m52.144854647s) [upload=149689]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 12 00:35:54.548090735 (133h35m52.144861761s) [upload=149689]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 12 00:35:54.682468585 (133h35m52.279239608s) [upload=149689]: Done uploading segments... Mar 12 00:35:54.682489239 (133h35m52.279260263s) [upload=149689]: Upload finished. err: <nil> Duration: 1m0.00420524s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.055557508s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 15:18:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.055576485s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.060587734s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 15:18:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.060615705s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.15062154s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 15:17:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.150655704s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.132842324s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 15:16:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.132866126s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.029903803s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 15:16:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.029942062s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [X....X......................................................] duration: 2.039647406s trace: https://jaeger.dev.storj.io/trace/49ac6d4af6e42dd0 FAIL (2026-03-11 15:15:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 24) ======LOGS====== ce... Mar 11 14:34:15.732468129 (123h34m13.329239154s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.732981179 (123h34m13.329752207s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.733578206 (123h34m13.330349232s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.735324481 (123h34m13.332095507s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746223300 (123h34m13.342994466s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.746816504 (123h34m13.343587523s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749233423 (123h34m13.346004442s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.749369138 (123h34m13.346140298s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:15.756539394 (123h34m13.353310411s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Uploading piece... Mar 11 14:34:16.153166662 (123h34m13.749937692s) [upload=138412]: Next returned nil segment Mar 11 14:34:16.153298066 (123h34m13.750069102s) [upload=138412]: Waiting for error group managing segments... Mar 11 14:34:16.329406819 (123h34m13.926177843s) [noise=true , address=89.149.201.147:4022 , piece_id=53SVTUTDUZ5JRICQC6QZDKBYCWI3BSONH2UFE3F5G24ZFOO2ZDJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.329957405 (123h34m13.926728441s) [noise=true , address=89.149.201.147:4006 , piece_id=LRUZA4KPAP4AY42HMB2WCBUM2MIUM5RFIUXYWWOVMGKWFHPQU52Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.338357420 (123h34m13.935128443s) [noise=true , address=81.171.14.70:4026 , piece_id=V77RTJYOIPARC6G5AOAMGX7IGD6NQYCC23HPTNSEDYYXFR5JPXMA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.355213925 (123h34m13.951984949s) [noise=true , address=81.171.14.70:4029 , piece_id=EJB6EEZZ7HH35JAM7AP2Y7XTAVFFTUOWFH4Y3IY4DSGURDWON3DA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.356966274 (123h34m13.953737297s) [noise=true , address=81.171.14.70:4033 , piece_id=FSSVTYTQXJWQQX56RJPFXTPC7XXEFBRSBIA5RF7HZ75K3VX4P7BA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.358133174 (123h34m13.954904197s) [noise=true , address=81.171.14.70:4046 , piece_id=62MXSXAQNAV5APDTM6YES2BTZLAHEJKFM6NTHZJMONRMD3ROXFFA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.366798007 (123h34m13.963569032s) [noise=true , address=185.167.204.205:4036 , piece_id=NYCDVZSEYJ47TBOQYH6HAPJ366UXJ772E22J7CFJCMOKL4OFKJ4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.370370931 (123h34m13.96714196s) [noise=true , address=185.167.204.206:4054 , piece_id=ZKQ5OK6KQRAQVL6KC4V345S4ATISYJHJFKQR5BMBHXOFUPLDMGJQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.371310879 (123h34m13.968081902s) [noise=true , address=89.149.201.147:4012 , piece_id=YRC6JJXZY4MSTIGFQI6NZPJJ7NRLRUH3N46FLVVXBUGMZ2ODUN3Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.381016147 (123h34m13.977787161s) [noise=true , address=89.149.201.147:4013 , piece_id=PNNDTD5XXB3P4U6BRPYBZ6RPN2Q4D5UX35KVZCNR44JNVZGFOLYQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.389871617 (123h34m13.98664264s) [noise=true , address=89.149.201.147:4019 , piece_id=77IJL2NLAYODEDGJ7WKMK7H6CA37PBO7VW2N334MTYTDQBEOMP6Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.399137676 (123h34m13.995908691s) [noise=true , address=89.149.201.147:4003 , piece_id=CULYXQAL5S6GTFZ52MTXJBL37NMGXHC5G2TBMEAF67N2C2SFJ4IQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.401682195 (123h34m13.998453221s) [noise=true , address=89.149.201.147:4016 , piece_id=AD266X27GVNYTYGWAQ3SNFHFXAAOPL2GYPYQY2ERFMOMKWCKNW6A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.407783584 (123h34m14.004554598s) [noise=true , address=185.167.204.205:4021 , piece_id=5UX6RAC3BFYZ6WYFIB64KJBO7E5HSRWLXO5FRKZWW6IR6BHVJSCA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.408492827 (123h34m14.00526386s) [noise=true , address=185.167.204.206:4056 , piece_id=V3VOV5KYYVYDSSFFKW3VYUYGDDT76ENMCB4LZJPNKR6ZKPM2YDQA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.416979215 (123h34m14.013750238s) [noise=true , address=185.167.204.206:4040 , piece_id=HWPZL6W5DTUN5UFFSMH2RHUXDDZHFKPJFHVH44AUVZRJJA2HZMEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.417158397 (123h34m14.01392942s) [noise=true , address=185.167.204.205:4027 , piece_id=7DCHZ2EAFKYLZS336CXG4QH2AXJ2BEKXXE5LF4DZYUXT7MEAWWXA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.419096266 (123h34m14.015867291s) [noise=true , address=89.149.201.147:4010 , piece_id=MCJAET45CA7XVCOSKTWAGFLSIDKVCTZCMZK5CCB5HHGF4JODRONA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.426516999 (123h34m14.023288023s) [noise=true , address=185.167.204.205:4029 , piece_id=L2MKBCZUVDG6KMZHYSRN7455KOCI5XYM47VJV2UUDZ546X233IWA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.451063834 (123h34m14.047834858s) [noise=true , address=185.167.204.206:4055 , piece_id=A6XA35AKTYAY72V6CDFL2JSZJZHI5AWGNP76XP4ABH5543ID574A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.465464138 (123h34m14.062235169s) [noise=true , address=89.149.201.147:4021 , piece_id=BQMQSZKZ7NTPC6ZP7EY2EUCLPIBXLRNTW6QKIAR3WRJMUFSI6OFQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.479738772 (123h34m14.076509785s) [noise=true , address=185.167.204.206:4039 , piece_id=N6MHZLPE7DCFJ5VTWXI7CB36JYLD45IZRQAHS5PTRABS2CQAHQ7A, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.513574930 (123h34m14.110345957s) [noise=true , address=185.167.204.206:4052 , piece_id=EBR3LBUZD5WZQSNES7ZENVVSZNB2Z6M7RLH34JWG45JSS7GVHPTA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:34:16.802456517 (123h34m14.399227531s) [noise=true , address=81.171.14.70:4030 , piece_id=4JHNVUINHWUZMJRHIA432FPP5QW2LUWQIMZNQTAMCUXTVZXE7FQQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: <nil> Mar 11 14:35:15.354196884 (123h35m12.95096791s) [noise=true , address=185.167.204.206:4043 , piece_id=6L5SUPZFW3ADX4GHQI4HPKJ5OFCMHUHCPQGQNONTPDTM3VNBIL4Q, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:56028->185.167.204.206:4043: use of closed network connection Mar 11 14:35:15.354474237 (123h35m12.951245268s) [noise=true , address=89.149.201.147:4024 , piece_id=Q6NWVZGPFIP4NRRSIFIM3ZKAXGIAKZDYWZ2QJLFOT3QGT3FQSDEQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 159.223.143.39:39554->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354630964 (123h35m12.951402008s) [noise=true , address=185.167.204.205:4004 , piece_id=WKWDAOPQY6IQOJZWN4CY23HDVTDTEHNGPA6PRBJTVBII2JDL6RAQ, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 159.223.143.39:44694->185.167.204.205:4004: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 11 14:35:15.354720068 (123h35m12.951491086s) [noise=true , address=185.167.204.205:4020 , piece_id=A53RTOPKEFZZA46MPFPLPMO6XC62YR3XJOFGHCLQCHLPSKIJ5XGA, seg_pos={0 0}, upload=138412]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:50752->185.167.204.205:4020: use of closed network connection Mar 11 14:35:15.354768382 (123h35m12.951539406s) [seg_pos={0 0}, upload=138412]: Done waiting for segment. successful: 24 optimal: 26 errs: <nil> Mar 11 14:35:15.454575321 (123h35m13.051346348s) [upload=138412]: Done uploading segments... Mar 11 14:35:15.454626371 (123h35m13.051397405s) [upload=138412]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 24) Duration: 2.039668605s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)