Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X....X.......] duration: 4.685126475s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:11:26 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 4.685160183s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................................X....X......] duration: 21.881386541s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:11:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 21.881492012s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 770.98847ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:11:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 771.024816ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................X....................] duration: 805.316373ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:10:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 805.347522ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................X...................] duration: 797.984595ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:10:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 798.048682ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X....X.....] duration: 2.370349493s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:10:13 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.370388025s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X....X....] duration: 1.963616306s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:09:54 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1.963653106s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................X..................] duration: 879.502411ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:09:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 879.527083ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X....X...] duration: 2.203628951s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:09:01 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.20365587s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X....X..] duration: 26.971748328s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:08:43 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 26.971784633s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................X.................] duration: 766.067382ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:08:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 766.094569ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................X................] duration: 818.741789ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:07:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 818.863305ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X....X.] duration: 2.041391556s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:07:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 2.041613659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X....X] duration: 1m0.00409846s trace: https://jaeger.dev.storj.io/trace/5e778fe7a13b60a0 FAIL (2026-05-25 11:07:08 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.096568326 (592h17m50.268686755s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097112562 (592h17m50.269230992s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.097632500 (592h17m50.269750931s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098148476 (592h17m50.270266905s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.098699871 (592h17m50.270818304s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099313777 (592h17m50.271432207s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.099840133 (592h17m50.271958563s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100162049 (592h17m50.272280479s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.100394430 (592h17m50.27251286s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101165405 (592h17m50.273283838s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101833189 (592h17m50.273951618s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.101859975 (592h17m50.273978416s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.102501215 (592h17m50.274619646s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103484544 (592h17m50.275602964s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.103611564 (592h17m50.275729993s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.104895143 (592h17m50.277013568s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.105575195 (592h17m50.277693619s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Uploading piece... May 25 11:06:38.617322517 (592h17m50.789440943s) [upload=663150]: Next returned nil segment May 25 11:06:38.617345221 (592h17m50.789463641s) [upload=663150]: Waiting for error group managing segments... May 25 11:06:38.720245841 (592h17m50.892364266s) [noise=true , address=212.102.52.215:4374 , piece_id=VO2KM6U3AU3BGKVSEXBTI2775GZ4KSZYUZQ5HKQXLP3V7UEQ3ASQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.722028135 (592h17m50.894146559s) [noise=true , address=212.102.52.216:4397 , piece_id=TAHVCE4K2ALUN62UFFOYCAF7VE6OTUEVL7GNBIQNBR2SVT5ODY3Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.723587957 (592h17m50.895706388s) [noise=true , address=212.102.52.213:4339 , piece_id=JATZ2POQ4OP5U6ELUQNV6CAAMJE3633TOMQ3IXZJYTPMTJAGJE3A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.724810236 (592h17m50.89692866s) [noise=true , address=212.102.52.217:4438 , piece_id=6ICU5AYURZ2UM3CCC4ECAMMZX3W3JTBSMUIMGQNVMQVAO7BMKXRA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.725946605 (592h17m50.898065029s) [noise=true , address=212.102.52.217:4430 , piece_id=56MEVCZCL42LAB2H4P5DQ2E5DBNAQDG4BWR356ATM3YRSTHQ5ZHA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.728488369 (592h17m50.900606793s) [noise=true , address=212.102.52.217:4429 , piece_id=3O53KNSNQ2CJCKE57AK67YSWISWCGG7UNMPWACOSZDITSOLSBLWQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.733448559 (592h17m50.905567172s) [noise=true , address=212.102.52.214:4361 , piece_id=MZE3SCRQXKRMTPAHSR6A7RWTD4D477ZJRN3ZSI4IO4HHIJBX6XWA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.734401330 (592h17m50.906519754s) [noise=true , address=212.102.52.216:4406 , piece_id=F3XU7ZHGNOXMWKELLARRXHKQM3W6UGHR7YTWZJJJY7RVK47B7PCA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.735527451 (592h17m50.90764588s) [noise=true , address=212.102.52.215:4390 , piece_id=QX3AZASWXGRINW3R5PM4YSFIVB67JUU5M5PENMDMGTOF4JYHTB6Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.738774235 (592h17m50.910892658s) [noise=true , address=212.102.52.215:4378 , piece_id=WT2PJKH7UJLVGOD3MYKLZ3DFWGNUU6VKK7YURZDV4NCG4DUMO2MA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739476480 (592h17m50.911594889s) [noise=true , address=212.102.52.213:4332 , piece_id=KX7QRN6HEFVA45Q3M6PBGAR2PZPBHN2VMANQ4NGKNMWLFBFIIWOQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.739896594 (592h17m50.91201503s) [noise=true , address=212.102.52.213:4343 , piece_id=6TOF22V4QQZQQMXUNF4DZONHDLVSONSTYAQSQYJAYCVUGEF5OIXQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740257541 (592h17m50.912375965s) [noise=true , address=212.102.52.214:4363 , piece_id=5HDNLRWJB52UX52BWG5JUPBQUJIQXHYKEL2L6X2FP5FE3S3PA27Q, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.740598623 (592h17m50.912717043s) [noise=true , address=212.102.52.214:4364 , piece_id=M5OBC7WVS6RLFRVMCRZPEGWETTIGYQKVS7MOBFSFWNK5TNUFQLUA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741254827 (592h17m50.913373247s) [noise=true , address=212.102.52.217:4431 , piece_id=YZRB2E5L3AS2OKRD56U73BJV67INEK4JPANK3ZBENUZI7TCWNXDA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741939503 (592h17m50.914057909s) [noise=true , address=212.102.52.216:4411 , piece_id=LPJTMKTEEPF3Y4G6WSQ422DSQ53CQMKP5R4FBO6IQIZGPES3GDZQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.741954456 (592h17m50.914072881s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 16 pieces May 25 11:06:38.742266991 (592h17m50.914385423s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16y12CqwtxrbMoBweh49rb4ZcgKgQqCNn3yApCJLQo3hJPBsoy): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.742278868 (592h17m50.914397275s) [noise=true , address=212.102.52.213:4326 , piece_id=H4SACSGFRP356NBXYLTMZEASDXJJBS6CWS44TXRIJRPRJM5BV7SQ, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.742882211 (592h17m50.915000634s) [noise=true , address=212.102.52.214:4358 , piece_id=HFPKCA3HYHFBXGLBPSZOGXZUYV4RWE5AP7KZ7FOMYPOUVXUMVJQA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.742899489 (592h17m50.915017913s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 17 pieces May 25 11:06:38.743560409 (592h17m50.915678829s) [noise=true , address=212.102.52.215:4388 , piece_id=ZFKJUACOPRCDKD3MRTVNBL5N4WR3PUOM2FGRZQQKOSC6FYSQPJ4A, seg_pos={0 0}, upload=663150]: Done uploading piece. err: <nil> May 25 11:06:38.743574497 (592h17m50.915692921s) [seg_pos={0 0}, upload=663150]: Satisfied cohort requirements after 18 pieces May 25 11:06:38.747671019 (592h17m50.919789675s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Phe9CqWEgoJLbxBLeSUDWMMmah4JR5tuyPENLK3GrfKE3xBs): protocol: expected piece hash; context canceled; EOF May 25 11:06:38.747692770 (592h17m50.919811199s) [noise=true , address=212.102.52.216:4416 , piece_id=NFP6MYIKDIO76Q25VRQHOKVS6KGW6QQI5E5WHITEGBSFM74BYGTA, seg_pos={0 0}, upload=663150]: Long tail cancellation due to optimal threshold May 25 11:06:38.747725328 (592h17m50.919843735s) [seg_pos={0 0}, upload=663150]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 11:06:38.747827383 (592h17m50.919946043s) [upload=663150]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:06:38.747874944 (592h17m50.919993376s) [upload=663150]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:06:45.559242654 (592h17m57.731361113s) [upload=663150]: Done uploading segments... May 25 11:06:45.559267229 (592h17m57.731385653s) [upload=663150]: Upload finished. err: <nil> Duration: 1m0.004394687s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............................................X...............] duration: 844.887066ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:06:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 844.974599ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............................................X..............] duration: 864.002472ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:06:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 864.031621ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............................................X.............] duration: 855.689981ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:05:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 855.718127ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 23.583459841s trace: https://jaeger.dev.storj.io/trace/6703bf2b127ea52f FAIL (2026-05-25 11:05:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 5 11:02:47.489531092 (592h13m59.661649515s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.489912686 (592h13m59.662031107s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490414636 (592h13m59.662533057s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490860469 (592h13m59.662978893s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491303060 (592h13m59.663421482s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491638732 (592h13m59.663757152s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492031688 (592h13m59.664150109s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492404276 (592h13m59.664522699s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492745464 (592h13m59.664863887s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493277626 (592h13m59.665396047s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493863704 (592h13m59.665982123s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494309840 (592h13m59.666428261s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494811214 (592h13m59.666929636s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.505463475 (592h13m59.677581894s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.509323012 (592h13m59.681441454s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.986855613 (592h14m0.158974038s) [upload=663070]: Next returned nil segment May 25 11:02:47.986876978 (592h14m0.158995404s) [upload=663070]: Waiting for error group managing segments... May 25 11:02:48.120803830 (592h14m0.292922265s) [noise=true , address=212.102.52.217:4429 , piece_id=HCICITGRIITNGXHYITW7UOJ3NBFQV2UTNAYRL72B554W7KT2U5AA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.120921133 (592h14m0.293039547s) [noise=true , address=212.102.52.216:4408 , piece_id=J2SITJLVU2DUEDQRKL3ENJVQ23BIG4P66QDJHN4FWB3KKSTCVR4Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.121834891 (592h14m0.293953318s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.122003384 (592h14m0.294121814s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125376336 (592h14m0.297494759s) [noise=true , address=212.102.52.214:4366 , piece_id=NMY45QRLPRUISZVURZNDGABGSORYYM2BLUNBTUMB5O5TBNOKCHDQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125904956 (592h14m0.29802338s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126321446 (592h14m0.298439872s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126641497 (592h14m0.298759917s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141143829 (592h14m0.313262252s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141515346 (592h14m0.313633788s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143185356 (592h14m0.315303777s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143284527 (592h14m0.315402937s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.144423996 (592h14m0.31654242s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.145527980 (592h14m0.31764639s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146469812 (592h14m0.31858822s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146794204 (592h14m0.318912613s) [noise=true , address=212.102.52.214:4364 , piece_id=KPYEPDHBSOPGHSNAZEOBBWR46O3GN3FMP7NFGPABKL7F32JEXW6Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146810158 (592h14m0.318928569s) [seg_pos={0 0}, upload=663070]: Satisfied cohort requirements after 16 pieces May 25 11:02:48.147109800 (592h14m0.319228228s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147119424 (592h14m0.319237846s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147149753 (592h14m0.319268181s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147162311 (592h14m0.319280739s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147383047 (592h14m0.319501477s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RQtuAbsJqQWMogK8y4ZNo6HY4Q3ffS2v6Y2RyPz267WPMxCE8): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147391126 (592h14m0.319509553s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148355954 (592h14m0.320474387s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.148370069 (592h14m0.3204885s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148405711 (592h14m0.320524121s) [seg_pos={0 0}, upload=663070]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 11:02:48.148515177 (592h14m0.320633601s) [upload=663070]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:02:48.148521550 (592h14m0.320639971s) [upload=663070]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:02:51.545270058 (592h14m3.71738849s) [upload=663070]: Done uploading segments... May 25 11:02:51.545296658 (592h14m3.717415086s) [upload=663070]: Upload finished. err: <nil> Duration: 23.583563996s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............................................X............] duration: 957.310755ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:04:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 957.341132ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.015849363s trace: https://jaeger.dev.storj.io/trace/6703bf2b127ea52f FAIL (2026-05-25 11:04:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 5 11:02:47.489531092 (592h13m59.661649515s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.489912686 (592h13m59.662031107s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490414636 (592h13m59.662533057s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490860469 (592h13m59.662978893s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491303060 (592h13m59.663421482s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491638732 (592h13m59.663757152s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492031688 (592h13m59.664150109s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492404276 (592h13m59.664522699s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492745464 (592h13m59.664863887s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493277626 (592h13m59.665396047s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493863704 (592h13m59.665982123s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494309840 (592h13m59.666428261s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494811214 (592h13m59.666929636s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.505463475 (592h13m59.677581894s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.509323012 (592h13m59.681441454s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.986855613 (592h14m0.158974038s) [upload=663070]: Next returned nil segment May 25 11:02:47.986876978 (592h14m0.158995404s) [upload=663070]: Waiting for error group managing segments... May 25 11:02:48.120803830 (592h14m0.292922265s) [noise=true , address=212.102.52.217:4429 , piece_id=HCICITGRIITNGXHYITW7UOJ3NBFQV2UTNAYRL72B554W7KT2U5AA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.120921133 (592h14m0.293039547s) [noise=true , address=212.102.52.216:4408 , piece_id=J2SITJLVU2DUEDQRKL3ENJVQ23BIG4P66QDJHN4FWB3KKSTCVR4Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.121834891 (592h14m0.293953318s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.122003384 (592h14m0.294121814s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125376336 (592h14m0.297494759s) [noise=true , address=212.102.52.214:4366 , piece_id=NMY45QRLPRUISZVURZNDGABGSORYYM2BLUNBTUMB5O5TBNOKCHDQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125904956 (592h14m0.29802338s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126321446 (592h14m0.298439872s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126641497 (592h14m0.298759917s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141143829 (592h14m0.313262252s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141515346 (592h14m0.313633788s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143185356 (592h14m0.315303777s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143284527 (592h14m0.315402937s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.144423996 (592h14m0.31654242s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.145527980 (592h14m0.31764639s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146469812 (592h14m0.31858822s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146794204 (592h14m0.318912613s) [noise=true , address=212.102.52.214:4364 , piece_id=KPYEPDHBSOPGHSNAZEOBBWR46O3GN3FMP7NFGPABKL7F32JEXW6Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146810158 (592h14m0.318928569s) [seg_pos={0 0}, upload=663070]: Satisfied cohort requirements after 16 pieces May 25 11:02:48.147109800 (592h14m0.319228228s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147119424 (592h14m0.319237846s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147149753 (592h14m0.319268181s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147162311 (592h14m0.319280739s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147383047 (592h14m0.319501477s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RQtuAbsJqQWMogK8y4ZNo6HY4Q3ffS2v6Y2RyPz267WPMxCE8): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147391126 (592h14m0.319509553s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148355954 (592h14m0.320474387s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.148370069 (592h14m0.3204885s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148405711 (592h14m0.320524121s) [seg_pos={0 0}, upload=663070]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 11:02:48.148515177 (592h14m0.320633601s) [upload=663070]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:02:48.148521550 (592h14m0.320639971s) [upload=663070]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:02:51.545270058 (592h14m3.71738849s) [upload=663070]: Done uploading segments... May 25 11:02:51.545296658 (592h14m3.717415086s) [upload=663070]: Upload finished. err: <nil> Duration: 2.015882989s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.972495553s trace: https://jaeger.dev.storj.io/trace/6703bf2b127ea52f FAIL (2026-05-25 11:03:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 5 11:02:47.489531092 (592h13m59.661649515s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.489912686 (592h13m59.662031107s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490414636 (592h13m59.662533057s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490860469 (592h13m59.662978893s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491303060 (592h13m59.663421482s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491638732 (592h13m59.663757152s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492031688 (592h13m59.664150109s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492404276 (592h13m59.664522699s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492745464 (592h13m59.664863887s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493277626 (592h13m59.665396047s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493863704 (592h13m59.665982123s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494309840 (592h13m59.666428261s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494811214 (592h13m59.666929636s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.505463475 (592h13m59.677581894s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.509323012 (592h13m59.681441454s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.986855613 (592h14m0.158974038s) [upload=663070]: Next returned nil segment May 25 11:02:47.986876978 (592h14m0.158995404s) [upload=663070]: Waiting for error group managing segments... May 25 11:02:48.120803830 (592h14m0.292922265s) [noise=true , address=212.102.52.217:4429 , piece_id=HCICITGRIITNGXHYITW7UOJ3NBFQV2UTNAYRL72B554W7KT2U5AA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.120921133 (592h14m0.293039547s) [noise=true , address=212.102.52.216:4408 , piece_id=J2SITJLVU2DUEDQRKL3ENJVQ23BIG4P66QDJHN4FWB3KKSTCVR4Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.121834891 (592h14m0.293953318s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.122003384 (592h14m0.294121814s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125376336 (592h14m0.297494759s) [noise=true , address=212.102.52.214:4366 , piece_id=NMY45QRLPRUISZVURZNDGABGSORYYM2BLUNBTUMB5O5TBNOKCHDQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125904956 (592h14m0.29802338s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126321446 (592h14m0.298439872s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126641497 (592h14m0.298759917s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141143829 (592h14m0.313262252s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141515346 (592h14m0.313633788s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143185356 (592h14m0.315303777s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143284527 (592h14m0.315402937s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.144423996 (592h14m0.31654242s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.145527980 (592h14m0.31764639s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146469812 (592h14m0.31858822s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146794204 (592h14m0.318912613s) [noise=true , address=212.102.52.214:4364 , piece_id=KPYEPDHBSOPGHSNAZEOBBWR46O3GN3FMP7NFGPABKL7F32JEXW6Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146810158 (592h14m0.318928569s) [seg_pos={0 0}, upload=663070]: Satisfied cohort requirements after 16 pieces May 25 11:02:48.147109800 (592h14m0.319228228s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147119424 (592h14m0.319237846s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147149753 (592h14m0.319268181s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147162311 (592h14m0.319280739s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147383047 (592h14m0.319501477s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RQtuAbsJqQWMogK8y4ZNo6HY4Q3ffS2v6Y2RyPz267WPMxCE8): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147391126 (592h14m0.319509553s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148355954 (592h14m0.320474387s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.148370069 (592h14m0.3204885s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148405711 (592h14m0.320524121s) [seg_pos={0 0}, upload=663070]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 11:02:48.148515177 (592h14m0.320633601s) [upload=663070]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:02:48.148521550 (592h14m0.320639971s) [upload=663070]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:02:51.545270058 (592h14m3.71738849s) [upload=663070]: Done uploading segments... May 25 11:02:51.545296658 (592h14m3.717415086s) [upload=663070]: Upload finished. err: <nil> Duration: 1.972527369s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................................................X...........] duration: 812.125225ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:03:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 812.18212ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.018272814s trace: https://jaeger.dev.storj.io/trace/6703bf2b127ea52f FAIL (2026-05-25 11:03:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 5 11:02:47.489531092 (592h13m59.661649515s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.489912686 (592h13m59.662031107s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490414636 (592h13m59.662533057s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490860469 (592h13m59.662978893s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491303060 (592h13m59.663421482s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491638732 (592h13m59.663757152s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492031688 (592h13m59.664150109s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492404276 (592h13m59.664522699s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492745464 (592h13m59.664863887s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493277626 (592h13m59.665396047s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493863704 (592h13m59.665982123s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494309840 (592h13m59.666428261s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494811214 (592h13m59.666929636s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.505463475 (592h13m59.677581894s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.509323012 (592h13m59.681441454s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.986855613 (592h14m0.158974038s) [upload=663070]: Next returned nil segment May 25 11:02:47.986876978 (592h14m0.158995404s) [upload=663070]: Waiting for error group managing segments... May 25 11:02:48.120803830 (592h14m0.292922265s) [noise=true , address=212.102.52.217:4429 , piece_id=HCICITGRIITNGXHYITW7UOJ3NBFQV2UTNAYRL72B554W7KT2U5AA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.120921133 (592h14m0.293039547s) [noise=true , address=212.102.52.216:4408 , piece_id=J2SITJLVU2DUEDQRKL3ENJVQ23BIG4P66QDJHN4FWB3KKSTCVR4Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.121834891 (592h14m0.293953318s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.122003384 (592h14m0.294121814s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125376336 (592h14m0.297494759s) [noise=true , address=212.102.52.214:4366 , piece_id=NMY45QRLPRUISZVURZNDGABGSORYYM2BLUNBTUMB5O5TBNOKCHDQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125904956 (592h14m0.29802338s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126321446 (592h14m0.298439872s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126641497 (592h14m0.298759917s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141143829 (592h14m0.313262252s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141515346 (592h14m0.313633788s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143185356 (592h14m0.315303777s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143284527 (592h14m0.315402937s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.144423996 (592h14m0.31654242s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.145527980 (592h14m0.31764639s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146469812 (592h14m0.31858822s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146794204 (592h14m0.318912613s) [noise=true , address=212.102.52.214:4364 , piece_id=KPYEPDHBSOPGHSNAZEOBBWR46O3GN3FMP7NFGPABKL7F32JEXW6Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146810158 (592h14m0.318928569s) [seg_pos={0 0}, upload=663070]: Satisfied cohort requirements after 16 pieces May 25 11:02:48.147109800 (592h14m0.319228228s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147119424 (592h14m0.319237846s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147149753 (592h14m0.319268181s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147162311 (592h14m0.319280739s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147383047 (592h14m0.319501477s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RQtuAbsJqQWMogK8y4ZNo6HY4Q3ffS2v6Y2RyPz267WPMxCE8): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147391126 (592h14m0.319509553s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148355954 (592h14m0.320474387s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.148370069 (592h14m0.3204885s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148405711 (592h14m0.320524121s) [seg_pos={0 0}, upload=663070]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 11:02:48.148515177 (592h14m0.320633601s) [upload=663070]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:02:48.148521550 (592h14m0.320639971s) [upload=663070]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:02:51.545270058 (592h14m3.71738849s) [upload=663070]: Done uploading segments... May 25 11:02:51.545296658 (592h14m3.717415086s) [upload=663070]: Upload finished. err: <nil> Duration: 2.018305598s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.00305109s trace: https://jaeger.dev.storj.io/trace/6703bf2b127ea52f FAIL (2026-05-25 11:03:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 5 11:02:47.489531092 (592h13m59.661649515s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.489912686 (592h13m59.662031107s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490414636 (592h13m59.662533057s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.490860469 (592h13m59.662978893s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491303060 (592h13m59.663421482s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.491638732 (592h13m59.663757152s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492031688 (592h13m59.664150109s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492404276 (592h13m59.664522699s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.492745464 (592h13m59.664863887s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493277626 (592h13m59.665396047s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.493863704 (592h13m59.665982123s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494309840 (592h13m59.666428261s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.494811214 (592h13m59.666929636s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.505463475 (592h13m59.677581894s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.509323012 (592h13m59.681441454s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Uploading piece... May 25 11:02:47.986855613 (592h14m0.158974038s) [upload=663070]: Next returned nil segment May 25 11:02:47.986876978 (592h14m0.158995404s) [upload=663070]: Waiting for error group managing segments... May 25 11:02:48.120803830 (592h14m0.292922265s) [noise=true , address=212.102.52.217:4429 , piece_id=HCICITGRIITNGXHYITW7UOJ3NBFQV2UTNAYRL72B554W7KT2U5AA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.120921133 (592h14m0.293039547s) [noise=true , address=212.102.52.216:4408 , piece_id=J2SITJLVU2DUEDQRKL3ENJVQ23BIG4P66QDJHN4FWB3KKSTCVR4Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.121834891 (592h14m0.293953318s) [noise=true , address=212.102.52.216:4406 , piece_id=A6XOY3FAXT3Y64H6D34UGHRBWHVCTCJHKZUSIAHFSQLZTF5WRZ7Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.122003384 (592h14m0.294121814s) [noise=true , address=212.102.52.216:4396 , piece_id=MB5GB43VNJU3SOYLXYVP2FDYPCAZ2QNH7XA7EO6DKXX3SVAYG6IQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125376336 (592h14m0.297494759s) [noise=true , address=212.102.52.214:4366 , piece_id=NMY45QRLPRUISZVURZNDGABGSORYYM2BLUNBTUMB5O5TBNOKCHDQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.125904956 (592h14m0.29802338s) [noise=true , address=212.102.52.215:4389 , piece_id=XKWKUSMNBZJO3ABRMGN3VOATGEVOE5C55GWHDVPMQDY22TA6HXXA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126321446 (592h14m0.298439872s) [noise=true , address=212.102.52.214:4355 , piece_id=T2CODIDT4O2TGX7F4HXMNBEKONWAZCD7TRBQFNWG2SCV3ASGQB2A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.126641497 (592h14m0.298759917s) [noise=true , address=212.102.52.215:4386 , piece_id=NLF2NCM35P7IOAIACAJYO5N4MVK5JES6T5P5U6FPRRN3G5REKENQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141143829 (592h14m0.313262252s) [noise=true , address=212.102.52.215:4392 , piece_id=A4IJF2RFLQY2VG4HZ447KOCYITW763OJPPWNRTKYZKCFRZJQKMBQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.141515346 (592h14m0.313633788s) [noise=true , address=212.102.52.214:4360 , piece_id=6LGODG45O3FCYJZEIRGTLQCCBJG747L44IDJPIGZPQNEMKFC53YQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143185356 (592h14m0.315303777s) [noise=true , address=212.102.52.213:4338 , piece_id=4GBDI4U65JJ7FYE2P6X37I7HDIM3KQEL6Y3UP3LZR22VQ6WYK7WQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.143284527 (592h14m0.315402937s) [noise=true , address=212.102.52.217:4435 , piece_id=KS4M3GUYTIOETQIXTYEMEZIMQ5XCJIKESM5FRGEPE7AWF2V6MPVA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.144423996 (592h14m0.31654242s) [noise=true , address=212.102.52.216:4402 , piece_id=S2JRC2AVSDYJZW4NJS6QORAFUHMI25AKDOGWJLVHBAGANXD57WPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.145527980 (592h14m0.31764639s) [noise=true , address=212.102.52.213:4331 , piece_id=UAEXBFAJJNKDJABPDOBFQIRBMCQXF4WY4BBIJUOCFNWGXA4YF4JA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146469812 (592h14m0.31858822s) [noise=true , address=212.102.52.213:4330 , piece_id=KDSVWFXRKVC5HWDMX2AEWXMQHR3YEXFZAAJ2QSRAIU6QCNGGZ44A, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146794204 (592h14m0.318912613s) [noise=true , address=212.102.52.214:4364 , piece_id=KPYEPDHBSOPGHSNAZEOBBWR46O3GN3FMP7NFGPABKL7F32JEXW6Q, seg_pos={0 0}, upload=663070]: Done uploading piece. err: <nil> May 25 11:02:48.146810158 (592h14m0.318928569s) [seg_pos={0 0}, upload=663070]: Satisfied cohort requirements after 16 pieces May 25 11:02:48.147109800 (592h14m0.319228228s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ey8Bngj9b4FsVddkt7Gy54obDPDoerL8sLAZBmKekPejXhg5M): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147119424 (592h14m0.319237846s) [noise=true , address=212.102.52.217:4426 , piece_id=CTFEVLW7MHNO3TJAOHVD4CSRJCFMRJZYPO3JNTCB3PPPRHXSDYCA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147149753 (592h14m0.319268181s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12259awyjTZXky86DZr2q8ak5V5KQz6f9pWiTbR6KtnS8rhqDDo): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147162311 (592h14m0.319280739s) [noise=true , address=212.102.52.215:4376 , piece_id=P4L4CUEDMOEWY73CCDELDQRJ6LCTDIINNDJMUTWTHURVVRIBMVMA, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.147383047 (592h14m0.319501477s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RQtuAbsJqQWMogK8y4ZNo6HY4Q3ffS2v6Y2RyPz267WPMxCE8): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.147391126 (592h14m0.319509553s) [noise=true , address=212.102.52.213:4336 , piece_id=5JBBNOWROX7DFSQWWAHI2LM3AP73N62IDDBPHYSY37M3TFURUZPQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148355954 (592h14m0.320474387s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f4fqtM26XZspG77Sjho67Tx9ucw1hAwg98xbPxqUcE6f1nH5U): protocol: expected piece hash; context canceled; EOF May 25 11:02:48.148370069 (592h14m0.3204885s) [noise=true , address=212.102.52.217:4424 , piece_id=VGGZSY3ASFTJO5UFGQJF7OD2SDP7EC4VHLSK3NE4NNYJM5TXGQAQ, seg_pos={0 0}, upload=663070]: Long tail cancellation due to optimal threshold May 25 11:02:48.148405711 (592h14m0.320524121s) [seg_pos={0 0}, upload=663070]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 11:02:48.148515177 (592h14m0.320633601s) [upload=663070]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 11:02:48.148521550 (592h14m0.320639971s) [upload=663070]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 11:02:51.545270058 (592h14m3.71738849s) [upload=663070]: Done uploading segments... May 25 11:02:51.545296658 (592h14m3.717415086s) [upload=663070]: Upload finished. err: <nil> Duration: 1m0.003103593s core uplink uk-select-1 uk1-placement-17
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................................................X..........] duration: 838.550601ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:03:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 838.609157ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 842.421533ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:01:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 842.44893ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 857.688441ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:01:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 857.721692ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 824.704209ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:01:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 824.848282ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 883.860245ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 11:00:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 883.968827ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 818.810714ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 10:59:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 818.857618ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 1.023011232s trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 10:58:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.023051739s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 826.863802ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 10:58:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 826.894978ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 835.042549ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 10:57:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 835.071942ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 723.70018ms trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 10:56:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 723.734636ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 5.002828225s trace: https://jaeger.dev.storj.io/trace/fb23a289728c702 FAIL (2026-05-25 10:55:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002851026s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.01896953s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:07:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.019002156s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.982998103s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:07:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.983032244s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.012815801s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:06:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.0128521s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.997124919s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:05:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.99716472s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.946194088s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:04:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.946219905s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.536047424s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:03:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.536090436s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.937533529s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:03:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.937628389s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.028413557s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:02:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.028467173s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.051671384s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:01:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.05173954s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 6.883276459s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:00:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 6.883337507s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.339718036s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 10:00:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.339753014s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.413394572s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:59:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.413426608s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.939377583s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:58:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.9394017s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.968431508s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:57:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.968458942s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.967592957s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:56:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.967621984s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)